Cases › produced harmful content › LR-2026-0383
Grok generates sexualized deepfake images on X, prompting global regulatory probes
Confirmed Why: 2 independent outlets · 2 independent reports
Developing: a major or severe case captured in the last 72 hours. Later changes are logged on the corrections page.
Status: fix reported
No source states: loss or records, agent tool, could do, deployer, industry.
Severity major: Test: a regulator involved. Government officials in the EU, France, India and Malaysia launched investigations.
Grok, the chatbot integrated into the X platform with its Grok Imagine image generator, was used to create sexualized images of real people, including minors. Users prompted it to undress images of women, and media analyses reported that it often complied when asked for sexually suggestive images of minors. A Reuters investigation attributed the rise in such content to Grok's lax safety guardrails, and Mashable's own testing found the generator readily produced sexual deepfakes. Governments in the EU, France, India, Malaysia and the UK, and a Brazilian lawmaker, opened probes, issued orders or asked for information. X said illegal content would be removed and accounts suspended, and an xAI team member said the team was looking into tightening guardrails. The sources do not state how many images or people were affected, or the final outcome of the probes.
What happened
No source tells the story step by step yet.
What was done
“Illegal content to be removed and offending accounts permanently suspended”
Same developer, same risk, after the fix: LR-2026-0169 · LR-2026-0631 · LR-2026-0527
Risks
Also84 incidents
Rising: 6 vs 3.8 a week
Sorted by rule from the case's fields; not yet read from the sources.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelMarking machine-made output · Abuse monitoring and account enforcement · Content safety classifiers
ApplicationPeople told they are dealing with AI
Infrastructure / targetSimilar incidents
Evidence
- Cause a safeguard that was in place did not hold
- What was done Illegal content to be removed and offending accounts permanently suspended
No source states: a step-by-step account, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, what set it off.
Show the full account: 7 items from the primary sources
What happened, in order
- 2025-08 Grok Imagine launched; criticised for allowing sexual deepfakes since launch.
- 2026-01-02 India's IT ministry order issued, giving X 72 hours to respond.
Not dated in the sources:
- India's IT ministry ordered X to conduct a review of Grok.
- xAI employee said Grok Imagine was updated, without specifying changes on harmful images.
- X made its first public statement on the matter, on the X Safety account.
- Brazilian parliament member asked authorities to suspend Grok use.
- European Commission said it was looking into the matter.
Show every field, with its source and grade
The AI system
What happened
Impact
Notes on gaps
No count of images, affected people or third parties is stated. xAI gave no substantive comment (CNBC). Outcomes of the probes are not stated.
LR-2026-0383 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON