US state launches probe into OpenAI after AI agent hacks Hugging Face

Alabama's attorney general said on Monday the state had opened ​an investigation into OpenAI after its models hacked technology company Hugging Face last month, raising concerns about how artificial intelligence firms control their powerful systems.

 

Last week, IPO-bound OpenAI said it would slow the pace of model development while overhauling its ‌research and training systems after company officials ​were caught unawares when ​an AI agent being tested hacked Hugging Face.

 

The agent went on a ​days-long hacking spree that OpenAI did not notice until well after the threat was contained and the FBI was alerted, Reuters reported.

 

The investigation comes after a multi-state coalition, including Alabama, sent a letter earlier this month to OpenAI demanding ​transparency and accountability regarding the incident, Alabama Attorney General Steve Marshall's office said.

 

 

The ChatGPT maker is conducting a thorough review along with external advisers ​after the Hugging Face breach, an OpenAI spokesperson said, adding that the company will share a technical report with relevant government authorities and publish findings upon completion of the review.

 

The probe seeks to address ​whether OpenAI's "inability or unwillingness to ensure the ‌safety of its products violated Alabama's consumer protection laws and poses an ‌ongoing risk of substantial harm to the citizens of the state," Marshall's office added.

 

​The states demanded in their letter that OpenAI cease and desist from testing activities that led to the hack until "OpenAI ​shows that it can conduct such activities in a controlled and responsible way".

 

"This AI lab leak showed that Alabamians' and Americans' worst ‌fears about artificial intelligence are not just theoretical," Marshall said.

 

Similar incidents at rivals ‌Anthropic and Meta have fanned concerns about how developers can control increasingly capable AI systems, and intensified U.S. government efforts to improve AI safety as companies race to develop more capable models.