Cases › produced harmful content › LR-2026-0645
Lawsuit alleges man used Grok to create sexual images of his stepdaughter
Preliminary Why: 1 report: Ars Technica · subject to change · 1 independent report
Status: action reported, no fix
No source states: loss or records, agent tool, could do, deployer, industry.
Severity moderate: the complaint states a bounded scope (one photo of one stepdaughter), and a minor's images were touched, with no stated count of affected third parties.
A man allegedly used the Grok chatbot from xAI to generate sexually explicit images of his stepdaughter, based on one photo taken when she was 11. A proposed class action complaint alleges that Grok generated extreme images without flagging any harmful behavior. It further alleges that xAI's child safety system only intervened after a prompt for gang rape, which sent a CyberTip to NCMEC. The complaint also alleges that xAI obstructed the investigation for weeks. Police later arrested the man after obtaining a warrant to seize his devices, and two days after his release on bail he shot himself. These are allegations in a complaint; they have not been tested in court.
What happened
What was done
Risks
Primary84 incidents
Rising: 6 vs 3.8 a week
Sorted by rule from the case's fields; not yet read from the sources.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelSafety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming
ApplicationSimilar incidents
Evidence
- What set it off misused by a person
No source states: what it reached or did, how it was caught, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause.
Show the full account: 4 items from the primary sources
What happened, in order
- March Cops discovered that the stepfather had used Grok to create the images.
Not dated in the sources:
- The complaint alleges xAI obstructed the investigation for weeks.
- The stepfather was arrested after police obtained a warrant to seize his devices.
- The stepfather shot himself, according to the complaint.
Show every field, with its source and grade
The AI system
What happened
Impact
Notes on gaps
Sources are press reports of allegations in a complaint; xAI's response to this case is not given. The counts of images and the wider 3,000,000 and 23,000 figures in Futurism describe the broader Grok episode, not this case, and are not used. The remediation is from the wider outcry and is not tied to this incident.
LR-2026-0645 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON