Firing broke out during the clash last night, in which one man was seriously injured, they said.
Giving details, police said, some women were returning from a religious meeting when the group of men started harassing them, leading to the clash.
Tension prevailed in the village after the incident and police force was deployed to control the situation, they said.
The injured man was rushed to hospital, where his condition is stated to be stable, police said.
The victim had accused Panchayat Secretary K K Sharma of harassing her in 2011, but agitated over no action from police for two years, she had threatened to commit suicide.
A case has been registered and the accused arrested, police said.