Amid lawsuit over AI child abuse material, xAI sues one Grok user
xAI has filed a lawsuit against a user for allegedly using its Grok chatbot to generate child sexual abuse material and deepfakes. The move comes amid broader legal scrutiny regarding the safety safeguards of AI companies.
Why it matters
It underscores the growing legal and ethical responsibility of AI developers to police the misuse of their generative tools.
Elon Musk’s xAI has sued a user of its Grok AI chatbot, alleging that the U.S.-based man misused the technology and violated the Terms of Service and Acceptable Use Policy in order to create sexual deepfakes and child sexual abuse material (CSAM).
xAI sued South Carolina resident Terry Wayne Harwood, 67, who had been already arrested over child sexual exploitation charges in February
According to the lawsuit, Mr. Harwood “designed misleading prompts to circumvent Grok’s built-in safeguards and then abused the tool to convert non-sexual photographs into sexually explicit images without the photograph subjects’ knowledge or consent.”
The likenesses of minor children were also used to create “obscene images,” per the lawsuit.
xAI’s lawsuit indicates that it will take action against users who misuse Grok, rather than treating Grok and its inadequate safeguards as the source of AI-generated sexual deepfakes.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in