Cases › produced harmful content › LR-2026-0746
Grok alleged to have generated sexualized images of abuse victims
Preliminary Why: 1 report: The Guardian · subject to change · 1 independent report
Developing: a major or severe case captured in the last 72 hours. Later changes are logged on the corrections page.
Status: no action reported
No source states: loss or records, agent tool, could do, deployer, industry.
Severity major: Test met: regulator involved, as the California Attorney General's Office took action against xAI; thousands of children depicted, per researchers.
Grok, the chatbot developed by xAI, is alleged to have used real images of a child sexual abuse survivor to generate new illegal sexualized images of her. A Jane Doe lawsuit filed in a US district court in California says xAI ignored industry-standard safeguards, and that the resulting material appeared and spread on X. The plaintiff's attorneys also allege xAI ingested images of her abuse into its datasets after they were posted publicly. The Canadian Centre for Child Protection reportedly used image fingerprints to identify AI-generated material on X depicting her. Earlier this year, loose safeguards let users direct Grok to remove clothing from photos and generate sexualized images, and researchers reported thousands depicting children. The allegations are unproven in the reporting. After the reports, xAI restricted image creation on X to paying subscribers, though some images remain publicly visible.
What happened
No source tells the story step by step yet.
What was done
No source states an action or fix.
Risks
Primary84 incidents
Rising: 6 vs 3.8 a week
Sorted by rule from the case's fields; not yet read from the sources.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelSafety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming
ApplicationSimilar incidents
Evidence
No source states: a step-by-step account, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause, what set it off, what was done.
Show the full account: 5 items from the primary sources
What happened, in order
- January 2026 Scandal over non-consensual abuse and nudity images by Grok prompted global outrage and investigations.
- March Three Tennessee teenagers sued the company over Grok-generated sexualized images of them.
Not dated in the sources:
- Bot generated millions of sexualized images within weeks, including thousands depicting children, per CCDH researchers.
- Grok apologized for creating and distributing an image of two teenage girls in sexualized outfits.
- California Attorney General's Office took action against xAI, demanding it cease creating and distributing such images.
Show every field, with its source and grade
The AI system
What happened
Impact
Context
Notes on gaps
All harms are allegations in a lawsuit and press reports; xAI and SpaceX did not respond to requests for comment, so no company account is available. The exact date the abused images were generated, the lawsuit filing date (given only as last week), and the date of disclosure are not stated, so no event dates were entered.
LR-2026-0746 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON