San Francisco wants Google and Apple to remove AI ‘Nudification’ apps from their app stores

San Francisco officials are pressuring Google and Apple to remove AI-powered 'nudification' apps from their stores due to the creation of non-consensual sexual deepfakes. The move follows broader concerns about the misuse of generative AI and potential criminal activity.
Why it matters
Addresses the growing tension between tech platform regulation and the ethical risks posed by generative AI tools.
Nudification apps let users to misuse AI and create deepfake images by digitally undressing people using their photos or videos. This has led to the creation of non-consensual sexual deepfakes and nude images, which is a crime. These apps are hosted on various regulated and unregulated platforms.
Apple and Google — two of the largest application stores — have come under scrutiny in the city of San Francisco over multiple ‘nudification’ apps hosted on their respective app stores, per TechCrunch.
The two companies were sent multiple complaint letters about the presence of such apps in their app marketplaces, but they did not take action against them at the earliest. However, Apple and Google reiterated their stance on policy violating-apps and confirmed they had later taken action against the apps, per TechCrunch.
California takes a strict view of sexual deepfakes and the use of Generative AI to create criminal content.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in