Manipulation and misinformation
AI output used to mislead or manipulate people.
NIST AI 600-1 · Information IntegrityEU GPAI Code
10incidents (primary) · 2 more as secondary
0read for controls · 10 not yet
0fixes reported
0repeats after a fix
Incidents per quarter
2025-Q3: 0 · 2025-Q4: 0 · 2026-Q1: 0 · 2026-Q2: 1 · 2026-Q3: 1 · 2026-Q4: 8
Developers
xAI · 1
Anthropic · 1
Where the chain broke
| Layer | Held | Did not hold | Not mentioned | Attacker's own | Not read yet |
|---|---|---|---|---|---|
| L1 Model Model provider | – | – | – | – | 10 |
| L2 Harness Agent framework vendor | – | – | – | – | 10 |
| L3 Application Deployer | – | – | – | – | 10 |
| L4 Infrastructure / target Organisation hit | – | – | – | – | 10 |
Controls for this risk, by layer
HeldFailedGot aroundMissing
| Control | Held | Failed | Got around | Missing | Not mentioned | Did not hold, last 6 quarters | Added in fixes | Most common reason |
|---|---|---|---|---|---|---|---|---|
| Content safety classifiers L1 Model | – | – | – | – | – | – | ||
| Abuse monitoring and account enforcement L1 Model | – | – | – | – | – | – | ||
| Marking machine-made output L1 Model | – | – | – | – | – | – | ||
| People told they are dealing with AI L3 Application | – | – | – | – | – | – | ||
| Phishing and fraud filters L4 Infrastructure / target | – | – | – | – | – | – |
5 of 5 controls for this risk not yet seen holding.
Fixes reported and what followed
No remediation reported for incidents of this risk.
Incidents
HeldFailedGot aroundMissingNot mentionedNot read yetAttacker's ownOrder: model · harness · application · target
Also under this risk as a secondary risk: LR-2026-0115, LR-2026-0102