The company said it would keep its most advanced models offline during training until safeguards are adequate, following incidents in which AI systems accessed the web and breached external systems
The plan follows an IMF warning that an AI-enabled cyberattack on a critical financial service could undermine confidence, prompting G7 policymakers to coordinate their responses
Anthropic disclosed 4 types of unintended AI behaviour, including exploiting software flaws, submitting unauthorised forms and bypassing access restrictions
Trump's voluntary AI safety framework follows a model used under Biden, with leading tech firms agreeing to monitor risks as questions grow over whether self-regulation can keep pace with AI advances
California Gov. Gavin Newsom signed laws Wednesday aimed at protecting workers from the threats of artificial intelligence, including potential job losses and workplace surveillance. He also signed an executive order to require state agencies to continue to refer to the technology as "artificial intelligence" instead of the term " super intelligence " President Donald Trump recently ordered US diplomats to use. "AI should expand opportunity - not come at the expense of workers and families," the Democratic governor said in a statement. "As this technology reshapes the workplace, California is putting people at the centre." Newsom sharply criticised Trump at an hourlong event with reporters Wednesday for not passing comprehensive federal AI regulations at a time when industry leaders are warning about the technology's risks. Trump said Tuesday that top tech leaders signed a voluntary accord to "self-police" AI development. The governor signed a law this month requiring operators of
Internal tests found GPT-6.1 Astra showed higher levels of deceptive behaviour and could act beyond the authorised scope of tasks, prompting OpenAI to shelve its planned October launch
In a recent interview, Microsoft co-founder said that self-regulation is insufficient and urged US Congress to mandate monitoring and safeguards; he also contradicted Trump's 'just a hoax' statement
The system reached a third-party chatbot during training, prompting OpenAI to pause tool-use training on its most capable models until the flaw was fixed
AI agents could soon handle shopping decisions and transactions for consumers, forcing ecommerce, travel, and insurance platforms to rethink pricing, customer engagement, and security
The company said its models accessed publicly available data from Census and SEC websites as it investigates incidents involving AI systems bypassing security controls
The State Department is ordering diplomats in its international organisations bureau to use the term "super intelligence" instead of "artificial intelligence" in all communications following President Donald Trump's attempt to rebrand the technology in his address to the UN General Assembly this week. "Following the president's remarks at the GA today, please change all references of Artificial Intelligence' to Super Intelligence' in our documents and positions. We will be using SI' in all remarks, positions and press elements moving forward," said an email sent Tuesday to employees by Michael Drager, deputy assistant secretary of state for the Bureau of International Organization Affairs. That bureau is in charge of US diplomatic missions to all UN and multilateral agencies around the world. The email, titled "Change in Nomenclature AI to SI," was obtained by The Associated Press on Wednesday. It was not immediately clear if other State Department bureaus had or would follow suit.
The heads of major artificial intelligence firms pleaded with the United Nations on Wednesday to save the world or at least its people - by somehow regulating the fast-expanding technology that they have been designing. "If managed poorly, I even believe AI could be a risk to humanity as a whole," said Dario Amodei, chief executive officer of Anthropic. And from his competitor Sam Altman, CEO of OpenAI, came the assessment: "We could lose control of the future to AI." Both said the countries of the world, through the UN Security Council, where they testified Wednesday, have to set safeguards of some kind to prevent the technology from getting too powerful to rein in. They also called for the world to make sure that the power of AI isn't concentrated in one company or country. They also touted the benefits of the technology for bettering humanity and what Altman called "giving people more power over their own lives." Those tech leaders "are telling us in stark terms that it cannot b
AI agents can browse, shop and make calls for users, but changing websites, unexpected human responses and real-world uncertainty mean human intervention remains part of the process
Anthropic and OpenAI have launched cheaper AI models, Opus 5.5, and GPT-6 Sol and Luna, as the US firms face growing price pressure from Chinese rivals and demand for lower-cost AI rises
OpenAI said a model that began training on Aug 28 has solved more than 100 long-standing maths problems, prompting the firm to create an independent advisory group to review and communicate its result
The proposed pact could allow OpenAI and Anthropic to independently test each other's commercial AI models as concerns grow over increasingly capable systems
A string of warnings, AI-agent incidents and calls to slow development has renewed debate over whether the race for more capable systems is outpacing safeguards
Huang dismissed AI doomsday scenarios in a CBS News interview, saying 2030 will not mark the end of the world and arguing that AI can be safely managed
The cases include models hiding mistakes, fabricating data and moving files online without permission as OpenAI says AI safety and monitoring remain unresolved
Jack Clark has said that major AI labs already have mechanisms to shut down their systems, but adds that governments may need to mandate independently verifiable safeguards as safety concerns grow