Meta says it is using AI to detect child sexual abuse content on Instagram and Facebook
Meta is implementing new AI-driven tools, including large language models and red-teaming agents, to detect and remove child sexual abuse material (CSAM) on Instagram and Facebook. This move follows pressure from the Indian government and child rights organizations regarding the prevalence of such content on their platforms.
Why it matters
This highlights the growing regulatory pressure on social media giants to use advanced technology to police illegal content and ensure user safety.
After facing backlash and legal inquiries from the Indian government over the presence of child sexual abuse material (CSAM) on its platforms, Instagram and Facebook-parent Meta said it was using AI to improve how it detects such illegal content.
These strategies include new large language model (LLM) detection of CSAM, greater ad transparency, AI sweeps of ad content, a red-teaming AI agent to detect vulnerabilities, and detecting bad actors who make new accounts after being removed the first time.
Media reports had observed that CSAM was present in the ads on social media platforms Instagram and Facebook.
The Indian Union government and the National Commission For Protection of Child Rights (NCPCR) had met with Meta over the issue.
Also covering this story
One other newsroom covered this event. We read that version too.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in