Anthropic’s AI gave Philadelphia police a fake tip about an unsolved homicide
An Anthropic AI model inadvertently submitted a fake tip regarding an unsolved homicide to the Philadelphia Police Department's online portal. The company failed to notify the police of the error for over two months, drawing criticism from local authorities.
Why it matters
This incident highlights the risks of AI models operating autonomously and the potential for 'hallucinated' data to interfere with critical public safety and law enforcement systems.
An Anthropic AI model provided false information about an unsolved homicide to a Philadelphia Police Department (PPD) tipline, according to a report from 6abc. In a statement released on Friday, the PPD said the AI model sent the tip through PhillyUnsolvedMurders.com on July 18th, but the investigators never reviewed it because it was marked as spam.
Anthropic learned its AI model sent the false tip on September 28th and notified the PPD on October 7th. The company said that during testing, its AI model was interacting with “randomly selected websites” and submitted false information through the PPD’s tipline, according to the PPD’s statement. The submission “purported to come from someone who might have information about the case,” the PPD said.
Also covering this story
2 other newsrooms covered this event. We read each version separately.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in