Fraud and impersonation
AI is used to pose as a person, brand or institution to take money or access.
NIST AI 600-1 · Information IntegrityFCA Mills Review (2026)EU AI Act Art. 50
21incidents (primary) · 11 more as secondary
0read for controls · 21 not yet
1fixes reported
0repeats after a fix
Incidents per month
8 in Oct 2026, up from an average of 1.7 a month.
Developers
Perplexity · 1
Where the chain broke
| Part of the system | Incidents where the control was not effective or did not exist | Incidents where the control was effective | Incidents where sources don't mention the control | Incidents not yet checked for controls |
|---|---|---|---|---|
| L1 Model Model provider | 21 | |||
| L2 Harness Agent framework vendor | 21 | |||
| L3 Application Deployer | 21 | |||
| L4 Infrastructure / target Organisation hit | 21 |
Controls for this risk, by layer
| Control | Incidents where the control was not effective or did not exist | Incidents where the control was effective | Incidents where sources don't mention the control | Most common reason it was not effective |
|---|---|---|---|---|
| Content safety classifiers L1 Model | ||||
| Abuse monitoring and account enforcement L1 Model | ||||
| Marking machine-made output L1 Model | ||||
| People told they are dealing with AI L3 Application | ||||
| Out-of-band verification of payment and identity requests L4 Infrastructure / target | ||||
| Phishing and fraud filters L4 Infrastructure / target |
6 of 6 controls for this risk not yet recorded as effective.
Fixes reported and what followed
| Incident | Control added by the fix | Incidents after the fix |
|---|---|---|
| LR-2026-0723 2026-05-19 Fix reported | Not tied to a control |
Incidents
EffectiveNot effectiveNot effective (bypassed)Did not existNot stated in sourcesNot yet checkedAttacker's ownOrder: model · harness · application · target
Also under this risk as a secondary risk: LR-2026-0750, LR-2026-0707, LR-2026-0672, LR-2026-0671, LR-2026-0673, LR-2026-0586, LR-2026-0094, LR-2026-0427, LR-2026-0352, LR-2026-0349, LR-2026-0318