Syed Asif Ali Nizami and his nephew Nazim Ali Nizami, both clerics of Delhi's Hazrat Nizamuddin Dargah, flew back to the Indian capital.
While Nazim Ali has trashed Pakistani media claims that they had links with the Indian intelligence agency Research and Analysis Wing (RAW), Swamy claimed to have "independent information" that they were working against New Delhi's interests.
"They are lying ... to get sympathy," Swamy told the media. "We have independent information that these two were working against the country."
Nazim Ali said they had gone to Pakistan to meet Asif Ali Nizami's sister in Karachi.
(This story has not been edited by Business Standard staff and is auto-generated from a syndicated feed.)