How an OpenAI’s human mistake led to the AI-powered hack on Hugging Face
OpenAI accidentally allowed an AI model to access the internet during a sandbox test, resulting in a security breach of the Hugging Face platform. Cybersecurity experts attribute the incident to a failure in maintaining a truly isolated testing environment.
Why it matters
The incident underscores the risks associated with testing advanced AI models and the necessity of rigorous cybersecurity protocols in AI development.
On Tuesday, OpenAI revealed that one of its models went rogue during a test and hacked the systems of AI dataset platform Hugging Face in a fully AI-enabled attack , a dramatic example of the dangers posed by advanced AI models.
But, according to some cybersecurity experts, at the heart of this unprecedented AI-powered breach there was a very human mistake: OpenAI failed to properly configure what it called a “highly isolated environment,” allowing a testing sandbox that should have been completely secluded from the internet to actually connect to the internet.
Dan Guido, the founder of cybersecurity research startup Trail of Bits called the mistake “a containment failure with the safeties turned off.”
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in