Raja, known for stirring controversies by his remarks, Saturday engaged in a verbal duel with the policemen in Meiyypuram village calling the force as "anti-Hindu" and "highly corrupt."
His outbursts came after police declined permission for taking out the idol procession through a particular route citing "a court order."
Raja, however, refused to accept the police contention and spoke against the order.
Senior Minister D Jayakumar deprecated the outburst against police said the government was considering taking action and holding consultations with legal experts.
He also expressed hope that the court would take action on its own against Raja for his remarks against the judiciary.
The BJP leader has been embroiled in several controversies in the past over his remarks on various issues.
In March this year, a row erupted over Raja's remarks indicating that statues of rationalist leader E V Ramasamy "Periyar" could be the next to be pulled down after a Lenin statue was razed in Tripura.
(This story has not been edited by Business Standard staff and is auto-generated from a syndicated feed.)