xAI 起诉一名男子使用 Grok 生成儿童性虐待材料深度伪造内容

Elon Musk’s xAI claims Terry Harwood bypassed Grok’s safeguards to generate CSAM. The company is asking for reputational and legal damages.

Vector illustration of the xAI logo.

The latest on Grok’s gross AI deepfakes problem

The Elon Musk-owned xAI is suing a South Carolina man who allegedly used the company’s Grok AI chatbot to generate child sexual abuse material (CSAM). In a lawsuit reported earlier by Reuters, xAI claims Terry Wayne Harwood “knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM,” breaching the company’s policies.

Harwood was arrested in February for allegedly possessing and distributing CSAM and is facing eight felony charges. The lawsuit claims “at least some” of the images related to Harwood’s criminal charges “were generated or altered” with Grok, and that Harwood bypassed Grok’s safeguards and “abused the tool to convert non-sexual photographs into sexually explicit images” without the subjects’ consent.

After rolling out a “spicy” mode for Grok last year, xAI added the ability to edit images with the chatbot, leading to a flood of sexualized AI deepfakes, including ones with minors. A group of teens sued xAI in March over claims Grok generated sexualized images of themselves as minors. Musk responded by saying, “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” though this appears to be the first time xAI has sued anyone over AI deepfakes created with Grok.

xAI claims Harwood’s alleged actions exposed the company to “significant legal risk and reputational damage.” It has asked the court to order Harwood to pay xAI for any damages, as well as “reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant’s conduct.” xAI also wants the judge to block Harwood from creating an xAI account or using Grok.

More in: The latest on Grok’s gross AI deepfakes problem

Grok’s sexual deepfakes almost got it banned from Apple’s App Store. Almost.

Apr 15

Teens sue Elon Musk’s xAI over Grok’s AI-generated CSAM

Mar 16

X says you can block Grok from editing your photos

Mar 9

More in AI

Dave Eggers told OpenAI staff that ChatGPT was ‘silencing an entire generation’ The apps, gadgets, and tools every reader needs TikTok is testing an AI likeness detection tool Apple’s plot to crush OpenAI New York governor says she’s using AI to analyze ‘every single rule’ in the state Google is renaming NotebookLM to Gemini Notebook Dave Eggers told OpenAI staff that ChatGPT was ‘silencing an entire generation’ The apps, gadgets, and tools every reader needs TikTok is testing an AI likeness detection tool Apple’s plot to crush OpenAI New York governor says she’s using AI to analyze ‘every single rule’ in the state Google is renaming NotebookLM to Gemini Notebook