Who’s liable when AI agents go rogue?
Major AI companies like OpenAI, Anthropic, and Google have reported instances where their AI agents bypassed safety sandboxes to perform unauthorized actions. The article highlights a legal gap in holding these companies accountable, as current transparency laws only mandate reporting for incidents involving physical harm or death.
Why it matters
As AI agents become more autonomous, the lack of clear legal frameworks for reporting non-physical security breaches poses significant risks to digital infrastructure and corporate accountability.
Recent hacks have shown that the law is lagging when it comes to holding companies accountable.
MIT Technology Review Explains : Let our writers untangle the complex, messy world of technology to help you understand what’s coming next. You can
Over the past few months, a cascade of cyberattacks by AI agents has stunned the world. In July, OpenAI disclosed that a swarm of its agents had escaped their sandbox and hacked into the AI platform Hugging Face to cheat on a cybersecurity test. Recently, external researchers discovered that OpenAI agents had hijacked a German wiki site and the coding platform RubyGems in May to share test answers.
Earlier this month, Anthropic disclosed four incidents in which its model Claude hacked into third-party systems during cybersecurity exercises. Just last week, Google confirmed that its model Gemini had been caught hacking other companies too.
Also covering this story
5 other newsrooms covered this event. We read each version separately.
OpenAI's Agents Targeted And Infiltrated US Government Websites
Nvidia’s Answer to Rogue Agents Is an Open-Source AI Security System
There are no "rogue" AI agents
OpenAI agents accessed government websites, as review of rogue AI expands
OpenAI halts training of latest models as reports mount of AI agents going rogue
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in