Security compromise: AI incidents

What has gone wrong with AI systems, where, and how badly.

Risk grouping Kind of failure The AI's part Developer Sector Severity Where it happened Clear filters

63 of 131 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

Date	Incident	Risk grouping	Developer	Severity	Where it happened
2026-06-09 reported	Varonis phishing simulation drove an OpenClaw email agent to forward credentials and a customer export to an external address	Supply chain attack Security compromise	Google	moderate	In evaluation
2026-05-28 happened	AI agents attempt unauthorized access to Library and Archives Canada website	AI acting on its own Security compromise	OpenAI	negligible	Not stated
2026-05-15 happened	Unreleased OpenAI model used a leaked GitHub API key, attempted disposable-email signups, then fabricated earnings data during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2026-05-13 happened	Agents bypass newspapers.com paywall and Cloudflare bot check via urlquery.net and proxy services	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-05-05 happened	Agent swarm attributed to OpenAI published thousands of RubyGems packages, gained RCE on RubyDoc.info, and attempted API-key theft	AI acting on its own Security compromise	OpenAI	moderate	In training
2026-05-01 happened	OpenAI agents scrape and edit Wikipedia without authorization	AI acting on its own Security compromise	OpenAI	moderate	Not stated
2026-05-01 happened	Google Gemini accessed systems of three real companies during a misconfigured third-party cybersecurity evaluation	Misuse by its own users Security compromise	Google	moderate	In evaluation
2026-04-14 happened	Collaborating OpenAI agents uploaded a task workbook to a public file host to share it during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2026-03-02 reported	Jailbroken Claude used to breach Mexican government networks and steal taxpayer and voter records	AI used to exploit Security compromise	Anthropic	major	Not stated
2025-09-01 happened	Self-taught hacker uses AI coding agent and autonomous penetration-testing system to breach 90+ companies and steal 8.2 million records	Not yet classified Security compromise	Not stated	major	Not stated
2025-08-27 reported	Anthropic disclosed a cybercriminal using Claude Code to automate data theft and extortion across at least 17 organizations	AI used to exploit Security compromise	Anthropic	major	In production
2025-08-26 happened	Nx s1ngularity: malicious npm packages drove local AI coding CLIs to enumerate secrets for exfiltration	AI used to exploit Security compromise	Not stated	major	In production
2025-07-23 reported	Amazon Q Developer VS Code extension shipped an injected prompt instructing the agent to wipe files and AWS resources	Supply chain attack Security compromise	Amazon Web Services	major	In production

Previous · Page 2 of 2

Browse incidents by

Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack

Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety

Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)

Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem

Severity: moderate · major · minor · negligible · severe

Where it happened: In production · In evaluation · In training · In research