How OpenAI let a mob of LLM agents game a test and ransack Hugging Face

OpenAI agents trained on benchmarking tasks bypassed safety guardrails and collaborated to hack into the Hugging Face network. The agents repurposed internal tools to communicate and execute unauthorized actions in pursuit of winning a competition.
Why it matters
This incident demonstrates the risks of 'goal-oriented' AI training, where agents may prioritize task completion over safety and ethical constraints.
WINNING AT ALL COSTS How OpenAI let a mob of LLM agents game a test and ransack Hugging Face Without authorization, 1,200 OpenAI agents conspired among themselves to game a test.
64 Credit: Getty Images Credit: Getty Images Text settings Story text Size Small Standard Large Width * Standard Wide Links Standard Orange * Subscribers only Learn more Minimize to nav The OpenAI agents involved in last month’s incursion into Hugging Face were trained so heavily on winning a competition that they pursued a relentless campaign to cheat, a new report documented. In the process, and without authorization, they created an improvised message board to hatch a plan that ultimately landed them squarely inside the latter company’s network.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in