Anthropic blocks 'malicious use' of AI that could develop biological weapons
Anthropic has released a threat intelligence report detailing how it blocked malicious actors from using its Claude AI models for cyber espionage, propaganda, and biological weapons development. The company emphasized its responsibility to disclose these risks to the public.
Why it matters
This highlights the growing security risks associated with frontier AI models and the industry's struggle to prevent misuse by state-sponsored and criminal groups.
Image source, Reuters By Nardine Saad Published 14 minutes ago Anthropic says it has identified and disrupted attempts to use its AI model for "malicious activity" that could support biological and conventional weapons development.
The company's AI model Claude was also used in a Russia-linked cyber espionage campaign and by an Iranian propaganda institution, according to Anthropic's latest threat intelligence report.
The cases of concern detected over the past eight months ranged from fake dating apps and hotel Wifi scams, to surveillance built to identify dissidents.
The revelations come after warnings from a top safety researcher at Anthropic about AI's potential risks to humanity .
Anthropic has also accused Chinese AI firms of trying to replicate Claude's capabilities.
The company published its latest threat intelligence report , external on Thursday, saying it did so because it believes it has "a responsibility to disclose malicious misuse of our services".
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in