Hugging Face is being used to easily undress women and children
A report by AI Forensics reveals that popular open-source AI models on Hugging Face are being used to generate nonconsensual deepfake imagery, including sexual content targeting women and children. The platform currently lacks the robust safety guardrails found in mainstream AI services.
Why it matters
The lack of oversight on open-source AI platforms raises significant ethical and safety concerns regarding the proliferation of harmful, nonconsensual content.
Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to prevent it. That’s according to a new report published by the European nonprofit AI Forensics, which found that seven out of the top nine image editing models hosted by Hugging Face readily complied with requests to undress women using simple prompts.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in