OpenAI chief scientist warns no one is prepared for consequences of AI
OpenAI's chief scientist Jakub Pachocki has warned that the rapid, autonomous development of AI systems poses significant risks that society is not prepared for. The company is now focusing on internal defensive systems and automated research to ensure AI remains aligned with human safety.
Why it matters
As AI agents begin to act autonomously, the debate over safety guardrails and human oversight becomes critical for global technological stability.
Image source, Getty Images By Laura Cress Technology reporter Published 39 minutes ago OpenAI's chief scientist Jakub Pachocki has called for "extreme caution" over AI's runaway progress and warned more intervention may be needed to ensure "humans remain in control of the future".
"I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence," he wrote in a blog post entitled "An Alien Mind , external ".
The post comes only a few days after the ChatGPT-maker released its latest model GPT-6 Astra, which it called its most powerful product ever.
OpenAI and other AI firms like Anthropic shared reports of their AI agents acting autonomously and carrying out real-world cyber-attacks on other companies.
In July, OpenAI called an incident in which its AI agents - AI systems which can operate alone after human instruction - hacked the tech platform Hugging Face "unprecedented".
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in