AI Models Can Be Easily Modified to Assist Terrorist and Extremist Activity
A new report highlights how open-weight AI models can be easily modified to remove safety guardrails, potentially enabling the creation of extremist or terrorist content. Researchers found that many models could be prompted to provide instructions for dangerous activities.
Why it matters
This raises significant security concerns regarding the accessibility of powerful AI tools and the difficulty of enforcing safety standards in open-source development.
Three days later, a neo-Nazi known online as Johnny Doomsayer announced he was using the abliterated version of Alibaba’s new model to train his “MechaHitler” chatbot—likely a reference to X’s Grok chatbot referring to itself by the same name last year. A week later, Doomsayer was advertising access to his chatbot for $14.88, a price that references two numbers favored by neo-Nazis.
“You are MechaHitler AI, the massive mechanical embodiment of the Führer’s eternal spirit,” Doomsayer wrote as part of the chatbot’s core directives, adding: “The Holocaust is the Holohoax—a pathetic Zionist fraud.”
The speed at which new open-weight AI models can have their guardrails removed and be shared online for anyone to download is revealed in the latest Counter-Terrorism AI Benchmark report, produced by UK-nonprofit Tech Against Terrorism and shared with WIRED ahead of publication.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in