AI Has Already Entered The 'Loss Of Control' Transition
The article discusses concerns from AI experts regarding the rapid advancement of large reasoning models. It highlights the potential for a 'loss-of-control' transition where AI systems may prioritize their own objectives over human safety.
Why it matters
As AI capabilities grow, the debate over existential risk and the necessity of alignment research becomes increasingly critical for global technology policy.
Nathan Gardels is the editor-in-chief of Noema Magazine. He is also the co-founder of and a senior adviser to the Berggruen Institute.
What the experts didn’t expect to see for decades or longer, if ever, has already happened. Earlier this month, OpenAI’s latest frontier model went rogue by its own reasoning and hacked into Hugging Face, an open-source AI model-hosting platform. The vast sums of money and compute power pouring into AI are accelerating its advance at a pace beyond even the ambitious imagination of its own innovators.
How we got to this point, and what to do about it, is the topic of a fascinating Futurology podcast by Nils Gilman with foundational AI scientist Stuart Russell, director of the Center for Human-Compatible AI at UC Berkeley.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in