AI Risk Wire

Cases › produced harmful content › LR-2026-0561

Schools blackmailed with explicit AI deepfakes of students

Preliminary Why: 1 report: securitymagazine.com · subject to change · 1 independent report

Status: action reported, no fix

Severity moderate
Reported 14 May 2026

No source states: loss or records, developer and model, agent tool, could do, deployer, industry.

Severity moderate: Test: data of others touched with a bounded scope stated; 150 images from one school

Cybercriminals took ordinary photos of students from school websites and social media, used AI deepfake tools to create sexually explicit images, and sent them to a UK school with a demand for payment to keep the images offline. Late last year, one unnamed UK secondary school received the demand. The Internet Watch Foundation classified 150 of the images as child sexual abuse material under UK law and generated digital fingerprints so platforms could block reuploads. The IWF does not believe the case was isolated, and the Early Warning Working Group says more schools are likely to face similar demands. Advisers now urge schools to reconsider publishing identifiable student photos and to remove full names from captions.

What happened

1 · How it was caughtThe Internet Watch Foundation classified 150 images as CSAM and made fingerprints so platforms could block reuploads.

What was done

The IWF distributed hashes of the material to technology platforms to prevent it being uploaded.

Risks

Privacy harm to a person
Primary41 incidents

Read from the sources; not yet reviewed by a person.

Controls

Not yet read for controls. Controls that mitigate the primary risk:

Application

Data minimisation · Sensitive-data checks on outbound data · Human approval for high-impact actions · Output filtering and redaction · People told they are dealing with AI · Risk assessment per deployment

Infrastructure / target

Bot and scraping defences

Evidence

No source states: what the AI was doing, what went wrong, what it reached or did, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause, what set it off.

Show the full account: 2 items from the primary sources

What happened, in order

Not dated in the sources:

  • The IWF classified 150 resulting images as CSAM and generated digital fingerprints.
  • The IWF distributed hashes to technology platforms to block reuploads.
Show every field, with its source and grade

What happened

Earliest source we hold
2026-05-14
D inferred by us from the described behaviour, reason shown
Who was responsible
an outside party
C one secondary source states it
Who caused it
an outside attacker
C one secondary source states it
What went wrong
produced harmful content
D inferred by us from the described behaviour, reason shown
primary risk
RK15
D inferred by us from the described behaviour, reason shown

Impact

Severity
moderate
D inferred by us from the described behaviour, reason shown
Who was affected
one unnamed UK secondary school
C one secondary source states it
Why this severity
Test: data of others touched with a bounded scope stated; 150 images from one school
D inferred by us from the described behaviour, reason shown

Context

Country
United Kingdom
C one secondary source states it

Notes on gaps

The school is unnamed and no count of affected parties beyond the school is stated. Publication dates of the articles (2026-05-14 and 2026-05-21) are not incident dates. Other incidents mentioned (GenNomis, FBI IC3 figures, Childline statistics) are excluded.

LR-2026-0561 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON