Hugging Face Has a Deepfake Nudes Problem
A report by AI Forensics reveals that the open-source platform Hugging Face is being used to generate nonconsensual deepfake nudes. Researchers found that a significant portion of user prompts on the site were sexual in nature, targeting women and children.
Why it matters
This raises critical questions about content moderation and safety responsibilities for open-source AI repositories hosting generative models.
The open-source AI platform Hugging Face—a repository of AI models and datasets, which has been valued in the billions—has a widespread problem with nonconsensual deepfakes, according to a new report published Tuesday by the European nonprofit AI Forensics. Researchers from the group say they tested nine of the top image editing Spaces on Hugging Face, which host models people can directly use on the site, and seven of these easily changed a clothed image of a woman into a topless one.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in