According to The Indian Express, the four men - Dhiraj Kumar Singh, Ajay Kumar, Prashant Kumar and Vinit Kumar Gupta – suspected to be from the Intelligence Bureau.
Delhi Police has taken them to the control room for questioning.
The suspects were intercepted when Verma's chief security officer found them sitting in a car, sources told IANS.
Delhi Police and the Central Bureau of Investigation (CBI) teams are looking into the matter.
After a government order, Verma and his deputy Special Director Rakesh Asthana were divested from their duties on Wednesday amid an unprecedented feud in the agency as the two hit out at each other over bribery accusations in the meat exporter Moin Qureshi money laundering case.
Video showing two of them being taken for questioning:
 "cbi feud")