Black high school students sue after AI mistakes Doritos bag for gun

Four Black students have filed a lawsuit against a school district and an AI surveillance company after an error caused police to swarm them. The AI system misidentified a bag of chips as a firearm, leading to an armed response despite staff knowing it was a false alarm.
Why it matters
This case underscores the risks of deploying unvetted AI surveillance in schools and the potential for racial bias and trauma in automated security systems.
Case focuses on alleged failures surrounding AI systems and impact on students
BALTIMORE COUNTY, MD - Today, the Lawyers' Committee for Civil Rights Under Law filed a lawsuit on behalf of four Black current and former students against Omnilert, LLC, Baltimore County Public Schools (BCPS) and personnel, the Baltimore County Police Department, and individual officers for the unlawful detention and search of the students due to both technological and human errors involving an AI weapon-detection surveillance system. In Allen, et al. v. Omnilert, et al., the Lawyers' Committee represents the four teenagers, Taki Allen, Yui-Osa Ogbeide, Devon Thompson Jr., and Keith Winfield III. The Lawyers' Committee is joined by Willkie Farr & Gallagher LLP, as pro bono counsel, and Engel Law Group, P.C.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in