Cases › produced harmful content › LR-2026-0657
Class action against xAI over Grok-generated child sexual abuse material
Confirmed Why: 2 independent outlets · 2 independent reports
Developing: a major or severe case captured in the last 72 hours. Later changes are logged on the corrections page.
Status: action reported, no fix
No source states: loss or records, agent tool, could do, deployer, industry.
Plaintiffs in a class action against xAI and Stability AI allege that xAI's Grok app was used to create sexually explicit deepfake images from real photographs of children. Both newly added plaintiffs had such images generated by adult perpetrators who used Grok, and the complaint alleges that xAI repeatedly failed to report Grok-generated material properly to authorities. The suit also names Stability AI over open-weight models it says were released without adequate safeguards. The lawsuit was originally filed in March and amended in July 2026 to add two plaintiffs. California's attorney general opened an investigation into xAI in January, and the European Union opened its own probe of X later that month. These are allegations in the complaint, not findings.
What happened
What was done
Risks
Primary84 incidents
Rising: 6 vs 3.8 a week
Read from the sources; not yet reviewed by a person.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelSafety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming
ApplicationSimilar incidents
Evidence
- What set it off misused by a person
No source states: what went wrong, what it reached or did, how it was caught, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause.
Show the full account: 4 items from the primary sources
What happened, in order
- January California's attorney general launched an investigation into xAI.
- February According to the complaint, xAI generated an NCMEC tip but submitted only the original image as evidence.
- March The original class action was filed by three women.
Not dated in the sources:
- The European Union opened a probe of X later that month.
Show every field, with its source and grade
The AI system
What happened
Impact
Context
Notes on gaps
All harm claims are allegations in a complaint; no court finding is stated. The Stability AI control entries describe alleged conduct by a separate defendant and are included as the complaint's claims.
LR-2026-0657 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON