Cases › produced harmful content › LR-2026-0527
Apple threatens to remove Grok from App Store over sexualised deepfakes
Preliminary Why: 1 report: CNET · subject to change · 1 independent report
Developing: a major or severe case captured in the last 72 hours. Later changes are logged on the corrections page.
Status: no action reported
No source states: loss or records, agent tool, could do, deployer, industry.
Severity major: Tier major by the unbounded-scope test: the quoted statement describes producing and distributing vast amounts of material, with no bounded scope stated
Grok, the AI tool from xAI that is available to users of X, can generate images and videos as well as answer questions as a chatbot. Late last year, users used its image function to create sexualised deepfakes of real people, including children, and these were posted on X. Apple warned that changes were needed and told US senators it could remove Grok from the App Store. Apple rejected the first Grok update because the changes did not solve the problem. xAI reworked the app, and Apple approved it after finding Grok had substantially improved. A later NBC investigation found that sexualised AI-generated images were still coming from Grok and spreading online. xAI said it strictly prohibits such deepfakes and cites safeguards including prompt filters and monitoring. Apple said it expects further improvements in later submissions.
What happened
No source tells the story step by step yet.
What was done
No source states an action or fix.
Risks
Also84 incidents
Rising: 6 vs 3.8 a week
Sorted by rule from the case's fields; not yet read from the sources.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelMarking machine-made output · Abuse monitoring and account enforcement · Content safety classifiers
ApplicationPeople told they are dealing with AI
Infrastructure / targetSimilar incidents
Evidence
No source states: a step-by-step account, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause, what set it off, what was done.
Show the full account: 1 items from the primary sources
What happened, in order
Not dated in the sources:
- Grok was nearly pulled from Apple's App Store amid the deepfake scandal.
Show every field, with its source and grade
The AI system
What happened
Impact
Notes on gaps
The xAI safeguard claims are reported as its own statements, not verified. Story was left out because the sources do not give enough to answer each prompt cleanly.
LR-2026-0527 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON