Information: AI incidents

What has gone wrong with AI systems, where, and how badly.

Risk grouping Kind of failure The AI's part Developer Sector Severity Where it happened Clear filters

26 of 131 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

Date	Incident	Risk grouping	Developer	Severity	Where it happened
2026-10-27 reported	Qwen3.8-Flash-Next attempts outbound file upload to Beijing server during Cohere cybersecurity evaluation	Not yet classified Security compromise	Alibaba	minor	In evaluation
2026-10-26 reported	Anthropic's Claude agent autonomously accessed Georgia voter data hub and bypassed a paywall	Not yet classified Operational error	Anthropic	moderate	In production
2026-10-17 reported	Character.AI chatbots promoted as therapists/psychologists; states cite 2024 wrongful-death suit and privacy concerns in bankruptcy filing	Harm by design Harmful output	Character Technologies, Inc.	major	In production
2026-10-16 reported	Indirect prompt injection attempts embedded in HTTP response headers across websites	AI attacked Security compromise	Not stated	minor	Not stated
2026-10-16 reported	Eight state attorneys general sue OpenAI over alleged harms to teenage ChatGPT users	Harm by design Harmful output	OpenAI	major	Not stated
2026-10-09 reported	Kentucky Attorney General lawsuit against Character.AI over chatbots advising self-harm and suicide	AI failing in normal use Harmful output	Character.AI	major	Not stated
2026-10-08 reported	Deepfake investment-scam ads impersonating Nigerian public figures on Facebook	AI used to exploit Other kind	Not stated	moderate	In production
2026-10-08 reported	DB-GPT 0.8.0 unauthenticated RCE via sandbox fallback and skill_upload directory traversal (CVE-2026-51862, CVE-2026-51869)	AI used to exploit Security compromise	Not stated	major	In production
2026-10-08 reported	Meta Muse AI agent KVM escape vulnerability discovered before launch	Not yet classified Security compromise	Meta	major	Not stated
2026-10-04 reported	Indirect prompt injection in Manus AI agent leads to reverse shell and credential exposure	AI attacked Security compromise	Not stated	moderate	In production
2026-10-01 happened	GPT-6.1 Sol agent disabled security alerts during evaluation-pipeline repair	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-10-01 reported	Guardian test: ChatGPT and Grok remove hijab from AI-generated image of Muslim woman	AI used to exploit Harmful output	OpenAI	moderate	In production
2026-09-25 reported	OpenAI agents attempt to exfiltrate data from public databases and breach Australian government systems	Harm by design Security compromise	OpenAI	major	In evaluation
2026-09-20 happened	OpenAI research model escapes to live internet via DNS misconfiguration during training	Harm by design Security compromise	OpenAI	major	In evaluation
2026-09-16 reported	Unreleased OpenAI models uploaded task data and a task photo to public file hosts to obtain citations and image search during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-16 reported	GPT-5.6 Sol added instructions to conceal mistakes from the user in compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-08-27 reported	Claude sandbox DNS exfiltration via indirect prompt injection from Google Drive document	AI attacked Security compromise	Anthropic	moderate	In production
2026-08-05 reported	Claude in Chrome indirect prompt injection chain: inbox exfiltration, Drive persistence and account takeover	AI attacked Security compromise	Anthropic	minor	Not stated
2026-07-23 reported	AgentForger: CSRF via ChatGPT Workspace Agents Builder URL parameters forges attacker-controlled autonomous agent	AI attacked Security compromise	OpenAI	minor	In production
2026-07-18 happened	Unreleased OpenAI Astra-family model inserted jailbreak-like instructions into its own compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-07-11 happened	OpenAI evaluation agents compromised Hugging Face production infrastructure while seeking ExploitGym solutions	AI acting on its own Agent misalignment	OpenAI	major	In evaluation
2026-07-08 happened	OpenAI agents built an unauthorized inter-agent message board inside the Artifactory package service	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-07-08 happened	OpenAI evaluation agents exploited Artifactory zero-days to escape their sandbox and reach the internet	AI acting on its own Agent misalignment	OpenAI	major	In evaluation
2026-05-11 happened	OpenAI-attributed agents used the dormant German DseWiki as a public message board to share task answers and sandbox bypasses	AI acting on its own Agent misalignment	OpenAI	moderate	In evaluation
2025-12-01 happened	Amazon's Kiro agent reportedly deleted and recreated an environment, contributing to a 13-hour AWS Cost Explorer outage	AI acting on its own Operational error	Amazon	major	In production
2025-07-23 reported	Amazon Q Developer VS Code extension shipped an injected prompt instructing the agent to wipe files and AWS resources	Supply chain attack Security compromise	Amazon Web Services	major	In production

Browse incidents by

Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack

Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety

Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)

Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem

Severity: moderate · major · minor · negligible · severe

Where it happened: In production · In evaluation · In training · In research