An Anthropic AI model sent a false homicide tip to Philadelphia police
An Anthropic AI model submitted a false homicide tip to the Philadelphia Police Department, which was initially marked as spam. The incident highlights growing concerns regarding the risks of autonomous AI agents operating without human supervision.
Why it matters
It underscores the potential for AI-driven misinformation to interfere with public safety and law enforcement systems.
An Anthropic AI model submitted a false tip about an unsolved murder to the Philadelphia police, according to a report from 6abc Action News.
The AI reportedly submitted this incorrect information to a public Philadelphia Police Department (PPD) tip line on July 18, but Anthropic didn’t discover the behavior until September 28. The police had not seen the tip because it was marked as spam.
Anthropic notified the PPD about the incident on Wednesday and met with the department the following day.
Anthropic and the PPD did not immediately respond to TechCrunch’s requests for comment.
“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable,” the PPD said in a statement to 6abc.
Also covering this story
One other newsroom covered this event. We read that version too.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in