Cameron found that King's College London, Queen Mary University and the School of Oriental and African Studies (SOAS) held the most number of events involving Islamist preachers on their campuses last year.
"All public institutions have a role to play in rooting out and challenging extremism. It is not about oppressing free speech or stifling academic freedom, it is about making sure that radical views and ideas are not given the oxygen they need to flourish," he said at the release of a report from the government's Extremism Analysis Unit.
The unit found that at least 70 events featuring hate speakers were held on campuses in 2014, and expressed concerns about the number of young people being radicalised and travelling to join Islamic State (ISIS) jihadists.
Among the speakers were Haitham Al-Haddad, Uthman Lateef, Alomgir Ali, Imran Ibn Mansur, also known as Dawah Man, Hamza Tzortis and Salman Butt, who have all publicly denounced British values.
This is the first time the UK government has detailed those institutions who most regularly host fanatics.
From September 21, a new legal duty will require colleges to put in place specific policies to stop extremists radicalising students, tackle gender segregation at events and support students at risk of radicalisation.
The so-called Prevent Duty requires establishments to ensure they have proper risk assessment processes for speakers and ensure those espousing extremist views do not go unchallenged.
UK Universities Minister Jo Johnson urged the National Union of Students (NUS) to drop its opposition to the Prevent anti-radicalisation strategy, which critics have claimed will create a culture of suspicion at academic institutions and could restrict freedom of speech.
"It is my firm view that we all have a role to play in challenging extremist ideologies and protecting students on campus. Ultimately, the Prevent strategy is about protecting people from radicalisation.
