Police said trouble broke out before the mill's gate following an altercation over lifting the three-day strike by some workers.
Two workers were injured during the clash.
A motorcycle, parked near the gate, was also set ablaze by a rampaging mob.
The situation was later brought under control.
Some workers went on strike in the jute mill following dispute over wages.
The mill management was not available for comments.