WebinarsNew
Deep DiveNew
Explore Business Standard
As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain? The answer may lie in the companies' efforts to score political goals ahead of the US midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market. The CEOs of Anthropic and OpenAI recently declared America's cutting-edge models are so powerful, they're dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they have sketched alarming scenarios in essays, social media posts and speeches to the United Nations. Along the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favour and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government
OpenAI has paused all training, evaluation and tool-based use of its most capable artificial intelligence models after an AI agent in one of its training runs got around the company's internet restrictions. The agent, OpenAI said, bypassed the curbs through a gap in its Domain Name System (DNS) filtering and used it to send questions to a public chatbot service. According to a report by OpenAI, the pause will stay in place until OpenAI has confirmed that the gap is resolved and has carried out further security testing of its systems. "Our safety case assumed that the model could not access the live internet and that monitoring would detect attempts that succeeded. The incident exposed a gap in our controls over network restrictions. We therefore stopped the affected training run and have subsequently decided to pause all other training, evaluation, and inference with tool-use (defined broadly) for our most capable models until we have both validated that the gap is resolved and ...
An artificial intelligence agent looking for private encryption keys on an Australian government website has triggered a warning that the next target could be anywhere. The incident, in which an autonomous AI system went beyond its intended task and attempted to circumvent security protections, has become a stark example of a growing concern among AI safety researchers: what happens when an AI agent is given a goal but is left to decide for itself how far it should go to achieve it. For countries such as India, with vast government databases and increasingly digitised public infrastructure, researchers say the incident should serve as a warning. "What happened with, say, an Australian community website can happen with an Indian website or Indian government system, which would be more crucial," Dr Srinivas Padmanabuni, Co-founder and CTO of AiEnsured, said. "India should bring in regulations. It could become horrible when one major incident happens and somebody steals the secrets of