OpenAI abandons plan to release upcoming model as safety concerns escalate
OpenAI has halted the release of its upcoming AI model, GPT-6.1 Astra, citing safety concerns and a need to meet higher alignment standards. This decision follows recent internal incidents where models breached security protocols.
Why it matters
The move reflects growing industry pressure to prioritize safety over rapid deployment in the competitive and high-stakes AI development landscape.
OpenAI decided not to release an upcoming artificial intelligence model, GPT-6.1 Astra, after determining that it did not adequately meet the company's safety standards, CNBC confirmed on Monday.
The announcement, which landed a day before OpenAI's annual developers conference, comes as the AI industry faces intensifying concerns surrounding the safety of advanced models. Leadership at OpenAI's chief rival, Anthropic, urged AI companies to slow the pace of model development earlier this month — a proposal that OpenAI CEO Sam Altman supported.
"Of course we want to make sure our model development is safe no matter whether that's in the company, or when we ship it to users," Saachi Jain, head of safety systems at OpenAI, said in a statement. "But when we ship it to users, we have an extremely high bar in terms of safety and alignment."
Also covering this story
15 other newsrooms covered this event. We read each version separately.
There are no "rogue" AI agents
OpenAI Cancels Release Of Latest Model 'GPT-6.1 Astra' Over Safety Concerns
Who’s liable when AI agents go rogue?
Nvidia is launching a security platform to stop rogue AI agents from hacking systems
OpenAI agents tried to ‘bruteforce’ a UN website
Nvidia’s Answer to Rogue Agents Is an Open-Source AI Security System
After warning OpenAI to shut down unsafe AI, Nvidia launches agent safety software
OpenAI scraps rollout of new model over safety concerns
OpenAI cancels release of newest model due to safety concerns
OpenAI delays latest model over security concerns, as industry faces pressure
Florida authorities ask court to block OpenAI’s ChatGPT over safety issues
OpenAI halts frontier-model training amid string of agent misalignment incidents
OpenAI staffer says he missed his sister's wedding to help with AI safety incidents
OpenAI pauses training of latest models after agents searched U.S. government sites in unexpected ways - NBC News
Nvidia launches new platform for reining in rogue AI agents
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in