AI Risk Wire

Cases › produced harmful content › LR-2026-0645

Lawsuit alleges man used Grok to create sexual images of his stepdaughter

Preliminary Why: 1 report: Ars Technica · subject to change · 1 independent report

Status: action reported, no fix

Severity moderate
Reported 8 Jul 2026
Developer and model Grok

No source states: loss or records, agent tool, could do, deployer, industry.

Severity moderate: the complaint states a bounded scope (one photo of one stepdaughter), and a minor's images were touched, with no stated count of affected third parties.

A man allegedly used the Grok chatbot from xAI to generate sexually explicit images of his stepdaughter, based on one photo taken when she was 11. A proposed class action complaint alleges that Grok generated extreme images without flagging any harmful behavior. It further alleges that xAI's child safety system only intervened after a prompt for gang rape, which sent a CyberTip to NCMEC. The complaint also alleges that xAI obstructed the investigation for weeks. Police later arrested the man after obtaining a warrant to seize his devices, and two days after his release on bail he shot himself. These are allegations in a complaint; they have not been tested in court.

What happened

1 · What it was doingA man allegedly used Grok to generate sexually explicit images of his stepdaughter from one photo of her taken when she was 11.
2 · What went wrongThe complaint says Grok generated extreme images without flagging any harmful behavior.

What was done

Two days after release on bail, the man shot himself, according to the complaint.

Risks

Harmful content and jailbreaks
Primary
84 incidents
Rising: 6 vs 3.8 a week

Sorted by rule from the case's fields; not yet read from the sources.

Controls

Not yet read for controls. Controls that mitigate the primary risk:

Model

Safety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming

Application

Output filtering and redaction

Similar incidents

All cases of this kind ›

Evidence

No source states: what it reached or did, how it was caught, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause.

Show the full account: 4 items from the primary sources

What happened, in order

  1. March Cops discovered that the stepfather had used Grok to create the images.

Not dated in the sources:

  • The complaint alleges xAI obstructed the investigation for weeks.
  • The stepfather was arrested after police obtained a warrant to seize his devices.
  • The stepfather shot himself, according to the complaint.
Show every field, with its source and grade

The AI system

Model
Grok
C one secondary source states it

What happened

Earliest source we hold
2026-07-08
D inferred by us from the described behaviour, reason shown
What set it off
misused by a person
C one secondary source states it
What went wrong
produced harmful content
C one secondary source states it

Impact

Severity
moderate
D inferred by us from the described behaviour, reason shown
Why this severity
the complaint states a bounded scope (one photo of one stepdaughter), and a minor's images were touched, with no stated count of affected third parties.
D inferred by us from the described behaviour, reason shown

Notes on gaps

Sources are press reports of allegations in a complaint; xAI's response to this case is not given. The counts of images and the wider 3,000,000 and 23,000 figures in Futurism describe the broader Grok episode, not this case, and are not used. The remediation is from the wider outcry and is not tied to this incident.

LR-2026-0645 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON