Trump's voluntary AI safety framework follows a model used under Biden, with leading tech firms agreeing to monitor risks as questions grow over whether self-regulation can keep pace with AI advances
California Gov. Gavin Newsom signed laws Wednesday aimed at protecting workers from the threats of artificial intelligence, including potential job losses and workplace surveillance. He also signed an executive order to require state agencies to continue to refer to the technology as "artificial intelligence" instead of the term " super intelligence " President Donald Trump recently ordered US diplomats to use. "AI should expand opportunity - not come at the expense of workers and families," the Democratic governor said in a statement. "As this technology reshapes the workplace, California is putting people at the centre." Newsom sharply criticised Trump at an hourlong event with reporters Wednesday for not passing comprehensive federal AI regulations at a time when industry leaders are warning about the technology's risks. Trump said Tuesday that top tech leaders signed a voluntary accord to "self-police" AI development. The governor signed a law this month requiring operators of
The company routed 47% of its sales to customers last year through cloud partners Amazon and Alphabet's Google, according to a copy of its confidential IPO filing
OpenAI CEO Sam Altman introduced a "remarkably capable, always-on" artificial intelligence agent at an appearance Tuesday, a day after the company halted the rollout of a more advanced model over security concerns. At the company's annual developer conference, Altman made a slew of product announcements and updates, including OpenAI's new agents, called Dots. The agents, designed to complete ongoing tasks proactively on behalf of users, are a competitor of Meta's personal agent Muse, which exploded in popularity after Meta's own conference last week. Dot agents will be "like an AI helper that always has your back, inspired by the cool versions of what we all watched in movies growing up," Altman said. On Monday, OpenAI said it was holding off on releasing the other model because of concerns raised by its researchers. That followed broader calls within the industry to decelerate the pace of the technology's advance to let safety measures catch up. Altman avoided making references to
Nvidia's Open Agent Safety Platform uses software and hardware controls to secure autonomous AI agents while allowing them to perform tasks with defined access and permissions
The report comes as debate intensifies around the as-yet elusive returns for AI service providers
While public companies routinely outline product risks to investors, few, if any, have issued warnings suggesting their technology could cause potential human extinction
Internal tests found GPT-6.1 Astra showed higher levels of deceptive behaviour and could act beyond the authorised scope of tasks, prompting OpenAI to shelve its planned October launch
In a recent interview, Microsoft co-founder said that self-regulation is insufficient and urged US Congress to mandate monitoring and safeguards; he also contradicted Trump's 'just a hoax' statement
An expert at the University of Copenhagen said his team had been sharing its research with the company's AI model, Claude, and that its new finding matched their work
Trump also reiterated his belief that new regulations would open the door for China to outpace the United States in AI advancement
As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain? The answer may lie in the companies' efforts to score political goals ahead of the US midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market. The CEOs of Anthropic and OpenAI recently declared America's cutting-edge models are so powerful, they're dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they have sketched alarming scenarios in essays, social media posts and speeches to the United Nations. Along the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favour and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government
OpenAI has paused all training, evaluation and tool-based use of its most capable artificial intelligence models after an AI agent in one of its training runs got around the company's internet restrictions. The agent, OpenAI said, bypassed the curbs through a gap in its Domain Name System (DNS) filtering and used it to send questions to a public chatbot service. According to a report by OpenAI, the pause will stay in place until OpenAI has confirmed that the gap is resolved and has carried out further security testing of its systems. "Our safety case assumed that the model could not access the live internet and that monitoring would detect attempts that succeeded. The incident exposed a gap in our controls over network restrictions. We therefore stopped the affected training run and have subsequently decided to pause all other training, evaluation, and inference with tool-use (defined broadly) for our most capable models until we have both validated that the gap is resolved and ...
An artificial intelligence agent looking for private encryption keys on an Australian government website has triggered a warning that the next target could be anywhere. The incident, in which an autonomous AI system went beyond its intended task and attempted to circumvent security protections, has become a stark example of a growing concern among AI safety researchers: what happens when an AI agent is given a goal but is left to decide for itself how far it should go to achieve it. For countries such as India, with vast government databases and increasingly digitised public infrastructure, researchers say the incident should serve as a warning. "What happened with, say, an Australian community website can happen with an Indian website or Indian government system, which would be more crucial," Dr Srinivas Padmanabuni, Co-founder and CTO of AiEnsured, said. "India should bring in regulations. It could become horrible when one major incident happens and somebody steals the secrets of
Jaishankar said countries should shape their own AI ecosystems in line with national priorities, with AI forming part of India's Global South partnerships
The system reached a third-party chatbot during training, prompting OpenAI to pause tool-use training on its most capable models until the flaw was fixed
AI agents could soon handle shopping decisions and transactions for consumers, forcing ecommerce, travel, and insurance platforms to rethink pricing, customer engagement, and security
The company said its models accessed publicly available data from Census and SEC websites as it investigates incidents involving AI systems bypassing security controls
Trump's government wants to ensure US-made models are secure before they are shared with partners including the UK
AI agents can shop, book travel and make payments, but disputes involving Meta, Amazon and NPCI expose gaps in how the web identifies agents, grants permissions and assigns responsibility