"We have removed the CCTV cameras after allegations from different quarters.
The administration will take a decision after reviewing the matter," Puri district collector Naba Kumar Das said.
The women tourists, who went to the beach to bathe, felt it was intruding on their privacy.
"We feel embarassed to bathe in the sea because of the CCTV cameras. How can I bathe when when I am being filmed?" asked a woman tourist from Mumbai.
The Beach Protection Council of Odisha (BPCO), a voluntary organisation, has also opposed CCTV cameras at the beach.
The two CCTV cameras were placed on the beach on Wednesday by the district administration to keep tabs on anti-social elements who troubled women visitors.
The district administration had spent about Rs 9 lakh for installing the two CCTV cameras.