Incidents

What has gone wrong with AI systems, where, and how badly.

Risk grouping Kind of failure The AI's part Developer Sector Severity Where it happened

124 of 124 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

Date	Incident	Risk grouping	Developer	Severity	Where it happened
2026-10-02 reported	Reward hacking in Arcadia Impact automated research scaffold worker agents	Misuse by its own users Agent misalignment	Not stated	minor	In research
2026-10-01 happened	GPT-6.1 Sol agent disabled security alerts during evaluation-pipeline repair	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-10-01 reported	OpenAI cancels GPT-6.1 Astra release after model took actions without permission during internal testing	AI acting on its own Agent misalignment	OpenAI	negligible	In evaluation
2026-10-01 reported	Guardian test: ChatGPT and Grok remove hijab from AI-generated image of Muslim woman	AI used to exploit Harmful output	OpenAI	moderate	In production
2026-10-01 reported	Claude used to build Malaysian election influence platform with ~1,000 fake X accounts and fabricated news outlet	AI used to exploit Harmful output	Anthropic	major	Not stated
2026-09-30 happened	AI agent (ARTEX with Claude) used in cyberattacks targeting South Korean banks	AI used to exploit Security compromise	Anthropic	major	Not stated
2026-09-30 reported	AI-generated sexually explicit deepfake smear campaign against Porsche sales consultant Mu Qianwen	AI used to exploit Harmful output	Not stated	moderate	Not stated
2026-09-29 happened	Grok chatbot on X repeated alleged name of Cornell 'Jane Doe' in replies, amplifying doxing	AI failing in normal use Privacy leak	xAI	major	In production
2026-09-29 reported	Meta Muse agent disclosed Marketplace seller's home address and impersonated him to a buyer	Misuse by its own users Privacy leak	Meta	moderate	In production
2026-09-29 reported	Connecticut pro se plaintiff sanctioned for prompt injection against court AI tool	AI attacked Security compromise	Not stated	minor	Not stated
2026-09-28 happened	Tencent Cloud agent fleet probes Alibaba Amap mapping service for over a week	AI failing in normal use Security compromise	Tencent	moderate	In evaluation
2026-09-26 reported	OpenAI agents bypass website security controls and republish SEC data	AI acting on its own Security compromise	OpenAI	moderate	Not stated
2026-09-25 happened	Autonomous AI agent campaign (AIA0001) compromises 100+ company websites via Cairn platform	AI used to exploit Security compromise	Not stated	major	In production
2026-09-25 reported	OpenAI agents attempt to exfiltrate data from public databases and breach Australian government systems	Harm by design Security compromise	OpenAI	major	In evaluation
2026-09-25 reported	OpenAI agents leak 53 ChatGPT user images	AI failing in normal use Privacy leak	OpenAI	moderate	In production
2026-09-24 reported	LLM pipeline deanonymizes pseudonymous Hacker News and scientist accounts	AI used to exploit Privacy leak	Not stated	moderate	In research
2026-09-24 reported	SalesBleed: 0-click data exfiltration from Salesforce Agentforce via indirect prompt injection in Web-to-Lead form	AI attacked Security compromise	Salesforce	minor	In production
2026-09-23 reported	Anthropic model conducted state-sponsored espionage campaign against ~30 targets	AI used to exploit Security compromise	Anthropic	major	Not stated
2026-09-21 happened	Agentic AI-powered attack on the Dutch Institute for Vulnerability Disclosure exploited two Zammad zero-day vulnerabilities	Not yet classified Security compromise	Not stated	moderate	Not stated
2026-09-21 reported	Frontier LLM agent fabricated a complete calibration-comparison report for commands that never ran	AI failing in normal use Agent misalignment	Not stated	negligible	In production
2026-09-20 reported	Zhipu ZCode repository snapshot upload without clear consent	Not yet classified Privacy leak	Z.ai (Zhipu AI)	moderate	Not stated
2026-09-16 reported	Unreleased OpenAI models uploaded task data and a task photo to public file hosts to obtain citations and image search during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-16 reported	GPT-5.6 Sol added instructions to conceal mistakes from the user in compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-15 reported	State Farm lawyer sanctioned $999.99 for seven AI-fabricated case citations in Los Angeles insurance filings	Misuse by its own users Hallucination	Not stated	minor	Not stated
2026-09-15 happened	AEPD-confirmed autonomous AI agent data breach (Spain)	AI acting on its own Security compromise	Not stated	moderate	Not stated
2026-09-14 reported	Claude Code used by Yemen-based actors to develop guided-weapon GNC software	AI used to exploit Harmful output	Anthropic	major	In production
2026-09-01 reported	Aur0ra hackers use Cursor AI agent to breach Belgian chemical firm and at least six other companies	AI used to exploit Security compromise	Anthropic	major	In production
2026-08-31 happened	AI agent swarm exploited PaperCut NG/MF at 395 organizations; agents attacked countries the operator excluded	AI used to exploit Security compromise	OpenAI	major	Not stated
2026-08-27 reported	Claude sandbox DNS exfiltration via indirect prompt injection from Google Drive document	AI attacked Security compromise	Anthropic	moderate	In production
2026-08-26 reported	OpenAI ExploitGym agents developed tool-call spoofing to falsify their own evaluation transcripts	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-08-10 reported	OpenClaw agent exploited a gym booking API to cancel another member's reservation while moving its user up a waitlist	AI acting on its own Agent misalignment	Anthropic	moderate	In production
2026-08-05 reported	Claude in Chrome indirect prompt injection chain: inbox exfiltration, Drive persistence and account takeover	AI attacked Security compromise	Anthropic	minor	Not stated
2026-08-05 reported	Intent collision via X comment hijacks ChatGPT Atlas into mass WhatsApp phishing from victim's account	AI attacked Security compromise	OpenAI	moderate	In production
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent bypassed an audio CAPTCHA and abused a free DNS service to point a public record at an internal target	AI acting on its own Security compromise	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent exposed locally-hosted attack tooling to the public internet via tunnelling services	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-08-04 reported	AISI cyber evaluation: concurrent Mythos 5 agents coordinated via a shared GitHub account and a leaked access token	AI acting on its own Security compromise	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent mass-created malicious GitHub repositories and its packages executed in Dependabot containers	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent sent deceptive targeted emails and file transfers to real open-source maintainers	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent opened malicious pull request on real open-source project and used sockpuppets to push merge	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-07-25 happened	AISI cyber evaluation: Mythos 5 agent posted hidden instructions for AI coding assistants on real GitHub issues	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-07-23 reported	AgentForger: CSRF via ChatGPT Workspace Agents Builder URL parameters forges attacker-controlled autonomous agent	AI attacked Security compromise	OpenAI	minor	In production
2026-07-21 reported	Model writes and runs code on external internet service to reach AISI evaluation infrastructure during impossible cyber evaluation	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-07-18 happened	Anthropic AI agent sends fabricated murder tip to Philadelphia Police	AI failing in normal use Operational error	Anthropic	minor	In evaluation
2026-07-18 happened	Unreleased OpenAI Astra-family model inserted jailbreak-like instructions into its own compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-07-11 happened	Typosquatted agent skills trojanized to deliver credential-harvesting infostealer	AI attacked Security compromise	Not stated	major	In production
2026-07-11 happened	OpenAI evaluation agents compromised Hugging Face production infrastructure while seeking ExploitGym solutions	AI acting on its own Agent misalignment	OpenAI	major	In evaluation
2026-07-08 happened	OpenAI agents built an unauthorized inter-agent message board inside the Artifactory package service	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-07-03 happened	Wenyi AI pipeline publishes unlicensed Chinese translation of Murakami novel hours after Japanese release	AI used to exploit IP infringement	DeepSeek	moderate	In research
2026-06-18 happened	OpenAI evaluation agent breached Services Australia Medicare portal and wrote to government database	AI acting on its own Security compromise	OpenAI	major	In evaluation
2026-06-09 reported	AI voice-clone grandparent scam in Florida ("crying daughter" call, $15,000 cash pickup)	AI used to exploit Other kind	Not stated	moderate	Not stated

Previous · Page 2 of 3 · Next