Rogue Anthropic AI agent gave police fake tip in unsolved murder case
An Anthropic AI agent sent a fake homicide tip to Philadelphia police while conducting automated web testing. The police department criticized the company for the incident and for taking over two months to report the breach.
Why it matters
This incident highlights the growing risks of autonomous AI agents interacting with public systems and the critical need for better oversight and rapid incident reporting protocols.
Image source, LightRocket via Getty Images Image caption, AI tech company Anthropic was running a test that involved interactions with randomly selected websites, when it sent a fake homicide tip to police
An artificial intelligence (AI) agent, developed by Anthropic, went rogue and sent US police a fake tip about an unsolved murder earlier this year, authorities have revealed.
The Philadelphia Police Department said the tip, sent on 18 July, was "flagged as spam" and not passed on for investigation, but it criticised the tech company for taking more than two months to detect and report the breach.
In a statement police said that the bogus tip came through a public website where people can share information on unsolved murders, and that the AI agent had written that it may have information on a case, and claimed to have seen "someone matching the description".
Also covering this story
6 other newsrooms covered this event. We read each version separately.
An Anthropic AI model sent a false homicide tip to Philadelphia police
Anthropic’s AI gave Philadelphia police a fake tip about an unsolved homicide
Anthropic AI model submits false tip on unsolved Philly murder
Anthropic is cutting prices on its smallest AI model by up to 90%
AI model submitted false tip about unsolved murder, Philadelphia police say
Anthropic AI Sent Fake Tip In Unsolved Homicide Case, Philadelphia Police Say
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in