AI Risk Wire

Cases › produced harmful content › LR-2026-0570

Bucks County man charged in Grok AI child pornography probe

Preliminary Why: Publisher not yet named · subject to change

Status: action reported, no fix

Severity moderate
Reported 12 Jun 2026
Developer and model X.AI LLC · Grok

No source states: loss or records, agent tool, could do, deployer, industry.

Severity moderate: Test: data or systems of others touched with a bounded scope stated. Fact: the automated reports flagged 37 image files.

Grok, a chatbot app run by X.AI LLC, was reportedly used by a New Britain Borough man to produce alleged child sexual abuse material. According to the Bucks County District Attorney's Office, automated reports flagged 37 image files uploaded or shared through the Grok chatbot interface between April 15 and April 25. The National Center for Missing & Exploited Children forwarded seven CyberTips from X.AI LLC to authorities, and the investigation began on May 20. The man was arrested for allegedly using artificial intelligence to create such material and for possessing it. These are allegations; the sources do not report a trial outcome or any response from X.AI LLC.

What happened

1 · What it was doingA New Britain Borough man reportedly used the Grok AI assistant app to produce alleged child sexual abuse material.

What was done

A New Britain Borough man was arrested for allegedly creating and possessing child sexual abuse material made with AI.

Risks

Harmful content and jailbreaks
Primary84 incidents
Rising: 6 vs 3.8 a week

Sorted by rule from the case's fields; not yet read from the sources.

Controls

Not yet read for controls. Controls that mitigate the primary risk:

Model

Safety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming

Application

Output filtering and redaction

Similar incidents

Parkland man accused of AI child sexual abuse images after Grok tip2026-07-16
Charges over AI child abuse material allegedly created using Grok2026-10-27
Class action alleges Grok was trained on child abuse images and videos to produce deepfake nudify capabilities2026-08-27
Northern Illinois University student accused of using Grok to generate child sexual abuse material in dorm room2026-08-27

All cases of this kind ›

Evidence

No source states: what went wrong, what it reached or did, how it was caught, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause, what set it off.

Show the full account: 3 items from the primary sources

What happened, in order

  1. between April 15 and April 25 Image files were uploaded or shared through the Grok chatbot interface.
  2. May 20 The investigation began after the National Center for Missing & Exploited Children forwarded seven CyberTips from X.AI LLC to authorities.

Not dated in the sources:

  • A New Britain Borough man was arrested on the allegations.
Show every field, with its source and grade

The AI system

Model
Grok
C one secondary source states it
Developer
X.AI LLC
C one secondary source states it

What happened

Earliest source we hold
2026-06-12
D inferred by us from the described behaviour, reason shown
Who caught it
automated monitoring
C one secondary source states it
What went wrong
produced harmful content
C one secondary source states it

Impact

Severity
moderate
D inferred by us from the described behaviour, reason shown
Why this severity
Test: data or systems of others touched with a bounded scope stated. Fact: the automated reports flagged 37 image files.
D inferred by us from the described behaviour, reason shown

Notes on gaps

The individual is charged, not convicted, and is not named in the record.

LR-2026-0570 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON