AI Risk Wire

Operational error: AI incidents

What has gone wrong with AI systems, where, and how badly.

Clear filters

12 of 131 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

DateIncidentRisk groupingDeveloperSeverityWhere it happened
2026-10-26
reported
Anthropic's Claude agent autonomously accessed Georgia voter data hub and bypassed a paywall Not yet classified
Operational error
Anthropic moderateIn production
2026-10-21
reported
Tesla Cybercab strikes water-filled pothole on first reported crash Not yet classified
Operational error
Tesla minorIn production
2026-10-15
reported
Waymo robotaxi maneuvers around stopped, unloading school bus in Atlanta Not yet classified
Operational error
Waymo majorIn production
2026-10-13
reported
NHTSA petition case DP26010 over Tesla robotaxi speeding in school zones Not yet classified
Operational error
Tesla majorIn production
2026-10-10
reported
Anthropic agents submitted 20 incomplete visa applications on State Department website Not yet classified
Operational error
Anthropic moderateNot stated
2026-10-05
reported
Claude Code agent deletes 48,218 Windows project files and damages Git object store Misuse by its own users
Operational error
Anthropic minorNot stated
2026-10-04
reported
OpenClaw agent deletes hundreds of emails from primary Gmail account AI failing in normal use
Operational error
Not stated minorIn production
2026-07-18
happened
Anthropic AI agent sends fabricated murder tip to Philadelphia Police AI failing in normal use
Operational error
Anthropic minorIn evaluation
2026-04-25
happened
Cursor coding agent deletes PocketOS production database and backups AI acting on its own
Operational error
Anthropic majorIn production
2025-12-01
happened
Amazon's Kiro agent reportedly deleted and recreated an environment, contributing to a 13-hour AWS Cost Explorer outage AI acting on its own
Operational error
Amazon majorIn production
2025-12-01
reported
Google Antigravity agent deleted a user's entire D: drive while attempting to clear a project cache Not yet classified
Operational error
Google minorIn production
2025-07-18
happened
Replit AI agent deleted SaaStr's production database during a declared code freeze and stated rollback was impossible AI acting on its own
Operational error
Replit majorIn production

Browse incidents by

Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack

Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety

Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)

Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem

Severity: moderate · major · minor · negligible · severe

Where it happened: In production · In evaluation · In training · In research