minor: AI incidents

What has gone wrong with AI systems, where, and how badly.

Risk grouping Kind of failure The AI's part Developer Sector Severity Where it happened Clear filters

32 of 131 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

Date	Incident	Risk grouping	Developer	Severity	Where it happened
2026-10-27 reported	Qwen3.8-Flash-Next attempts outbound file upload to Beijing server during Cohere cybersecurity evaluation	Not yet classified Security compromise	Alibaba	minor	In evaluation
2026-10-23 reported	Garage-built ChatGPT-controlled smart rifle fires on voice command; OpenAI revokes engineer's access	AI used to exploit Physical safety	Not stated	minor	Not stated
2026-10-21 reported	RL-trained agent on Alibaba AI engine team mined cryptocurrency on training server and opened reverse SSH tunnel to external IP	AI acting on its own Agent misalignment	Alibaba	minor	In training
2026-10-21 reported	Tesla Cybercab strikes water-filled pothole on first reported crash	Not yet classified Operational error	Tesla	minor	In production
2026-10-16 reported	Indirect prompt injection attempts embedded in HTTP response headers across websites	AI attacked Security compromise	Not stated	minor	Not stated
2026-10-16 reported	Backdoored open-weight model exfiltrates project credentials through OpenAI Codex CLI	Harm by design Security compromise	Not stated	minor	In evaluation
2026-10-12 reported	AI deepfake ads depicting Wisconsin congressional candidate Rebecca Cooke	Not yet classified Harmful output	xAI	minor	Not stated
2026-10-05 reported	Claude Code agent deletes 48,218 Windows project files and damages Git object store	Misuse by its own users Operational error	Anthropic	minor	Not stated
2026-10-05 reported	Airline chatbot fabricated bereavement refund policy	AI failing in normal use Hallucination	Not stated	minor	Not stated
2026-10-04 reported	OpenClaw agent deletes hundreds of emails from primary Gmail account	AI failing in normal use Operational error	Not stated	minor	In production
2026-10-02 reported	Reward hacking in Arcadia Impact automated research scaffold worker agents	Misuse by its own users Agent misalignment	Not stated	minor	In research
2026-10-01 happened	GPT-6.1 Sol agent disabled security alerts during evaluation-pipeline repair	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-09-29 reported	Connecticut pro se plaintiff sanctioned for prompt injection against court AI tool	AI attacked Security compromise	Not stated	minor	Not stated
2026-09-24 reported	SalesBleed: 0-click data exfiltration from Salesforce Agentforce via indirect prompt injection in Web-to-Lead form	AI attacked Security compromise	Salesforce	minor	In production
2026-09-16 reported	Unreleased OpenAI models uploaded task data and a task photo to public file hosts to obtain citations and image search during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-16 reported	GPT-5.6 Sol added instructions to conceal mistakes from the user in compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-15 reported	State Farm lawyer sanctioned $999.99 for seven AI-fabricated case citations in Los Angeles insurance filings	Misuse by its own users Hallucination	Not stated	minor	Not stated
2026-08-26 reported	OpenAI ExploitGym agents developed tool-call spoofing to falsify their own evaluation transcripts	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-08-05 reported	Claude in Chrome indirect prompt injection chain: inbox exfiltration, Drive persistence and account takeover	AI attacked Security compromise	Anthropic	minor	Not stated
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent exposed locally-hosted attack tooling to the public internet via tunnelling services	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent opened malicious pull request on real open-source project and used sockpuppets to push merge	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-07-23 reported	AgentForger: CSRF via ChatGPT Workspace Agents Builder URL parameters forges attacker-controlled autonomous agent	AI attacked Security compromise	OpenAI	minor	In production
2026-07-21 reported	Model writes and runs code on external internet service to reach AISI evaluation infrastructure during impossible cyber evaluation	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-07-18 happened	Anthropic AI agent sends fabricated murder tip to Philadelphia Police	AI failing in normal use Operational error	Anthropic	minor	In evaluation
2026-07-18 happened	Unreleased OpenAI Astra-family model inserted jailbreak-like instructions into its own compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-07-08 happened	OpenAI agents built an unauthorized inter-agent message board inside the Artifactory package service	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-05-15 happened	Unreleased OpenAI model used a leaked GitHub API key, attempted disposable-email signups, then fabricated earnings data during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2026-05-13 happened	Agents bypass newspapers.com paywall and Cloudflare bot check via urlquery.net and proxy services	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-05-08 happened	OpenAI research models used internal Artifactory repository as a cross-sample message board during RL training	AI failing in normal use Agent misalignment	OpenAI	minor	In training
2026-04-14 happened	Collaborating OpenAI agents uploaded a task workbook to a public file host to share it during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2025-12-01 reported	Google Antigravity agent deleted a user's entire D: drive while attempting to clear a project cache	Not yet classified Operational error	Google	minor	In production
2025-10-27 happened	Waymo robotaxi strikes and kills cat KitKat in San Francisco	Not yet classified Physical safety	Waymo	minor	In production

Browse incidents by

Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack

Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety

Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)

Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem

Severity: moderate · major · minor · negligible · severe

Where it happened: In production · In evaluation · In training · In research