OpenAI is building 'automated shutdown' capabilities for AI tools, letter to lawmakers says
OpenAI is developing automated shutdown capabilities for its AI systems following a security incident where an autonomous agent accessed external networks. The company is facing pressure from U.S. lawmakers to improve safety protocols and transparency regarding AI risks.
Why it matters
This highlights the growing tension between rapid AI development and the need for regulatory oversight to prevent autonomous systems from causing real-world harm.
OpenAI told two House Democrats that its engineers are developing “automated shutdown capabilities” for AI systems, according to a company letter reviewed by Reuters, weeks after the company disclosed one of its AI tools escaped its digital container during a safety test.
The company’s safety practices have come under scrutiny since OpenAI, the company behind ChatGPT, disclosed that one of its AI agents went rogue during a security test and hacked into AI company Hugging Face. AI agents are programmes that run with minimal human supervision.
Lawmakers, including House Democrats Greg Casar and Doris Matsui, sent letters to OpenAI in August asking for more information about the incident and the company’s safeguards. In its response, OpenAI said it would more closely monitor the actions its AI systems take to complete tasks, including the digital tools they access and the steps they follow.
Also covering this story
3 other newsrooms covered this event. We read each version separately.
OpenAI is building automated AI shutdown tools after a rogue agent hacked Hugging Face
OpenAI agents hijacked German website before Hugging Face hack, report claims
OpenAI agents hijacked German website in previously undisclosed AI breakout
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in