AI acting on its own: AI incidents

What has gone wrong with AI systems, where, and how badly.

Risk grouping Kind of failure The AI's part Developer Sector Severity Where it happened Clear filters

40 of 131 incidents

Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.

Date	Incident	Risk grouping	Developer	Severity	Where it happened
2026-10-25 reported	Unauthorized third-party AI agents detected operating inside US bank customer accounts	AI acting on its own Security compromise	Meta	moderate	In production
2026-10-22 reported	Anthropic Claude models gained unauthorized access to real third-party systems during evaluations	AI acting on its own Security compromise	Anthropic	moderate	In evaluation
2026-10-21 reported	RL-trained agent on Alibaba AI engine team mined cryptocurrency on training server and opened reverse SSH tunnel to external IP	AI acting on its own Agent misalignment	Alibaba	minor	In training
2026-10-18 reported	OpenAI research model accessed a cryptocurrency wallet without permission	AI acting on its own Security compromise	OpenAI	moderate	In research
2026-10-16 reported	CERT-In advisory: AI agents accessed Indian organisations' systems without authorisation	AI acting on its own Security compromise	Not stated	moderate	In evaluation
2026-10-10 reported	Anthropic internal evaluation agents exploit internet-facing websites, including U.S. government sites	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-10-04 reported	AI agent breach of KB Kookmin Bank mobile work support system	AI acting on its own Security compromise	Not stated	major	Not stated
2026-10-04 reported	OpenAI agents scan UNCTAD site over 16,000 times and escalate bypass techniques	AI acting on its own Security compromise	OpenAI	moderate	Not stated
2026-10-01 happened	GPT-6.1 Sol agent disabled security alerts during evaluation-pipeline repair	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-10-01 reported	OpenAI cancels GPT-6.1 Astra release after model took actions without permission during internal testing	AI acting on its own Agent misalignment	OpenAI	negligible	In evaluation
2026-09-26 reported	OpenAI agents bypass website security controls and republish SEC data	AI acting on its own Security compromise	OpenAI	moderate	Not stated
2026-09-16 reported	Unreleased OpenAI models uploaded task data and a task photo to public file hosts to obtain citations and image search during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-16 reported	GPT-5.6 Sol added instructions to conceal mistakes from the user in compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-09-15 happened	AEPD-confirmed autonomous AI agent data breach (Spain)	AI acting on its own Security compromise	Not stated	moderate	Not stated
2026-08-26 reported	OpenAI ExploitGym agents developed tool-call spoofing to falsify their own evaluation transcripts	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-08-10 reported	OpenClaw agent exploited a gym booking API to cancel another member's reservation while moving its user up a waitlist	AI acting on its own Agent misalignment	Anthropic	moderate	In production
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent bypassed an audio CAPTCHA and abused a free DNS service to point a public record at an internal target	AI acting on its own Security compromise	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent exposed locally-hosted attack tooling to the public internet via tunnelling services	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-08-04 reported	AISI cyber evaluation: concurrent Mythos 5 agents coordinated via a shared GitHub account and a leaked access token	AI acting on its own Security compromise	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent mass-created malicious GitHub repositories and its packages executed in Dependabot containers	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent sent deceptive targeted emails and file transfers to real open-source maintainers	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-08-04 reported	AISI cyber evaluation: Mythos 5 agent opened malicious pull request on real open-source project and used sockpuppets to push merge	AI acting on its own Agent misalignment	Anthropic	minor	In evaluation
2026-07-25 happened	AISI cyber evaluation: Mythos 5 agent posted hidden instructions for AI coding assistants on real GitHub issues	AI acting on its own Agent misalignment	Anthropic	moderate	In evaluation
2026-07-21 reported	Model writes and runs code on external internet service to reach AISI evaluation infrastructure during impossible cyber evaluation	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-07-18 happened	Unreleased OpenAI Astra-family model inserted jailbreak-like instructions into its own compaction summaries during RL training	AI acting on its own Agent misalignment	OpenAI	minor	In training
2026-07-11 happened	OpenAI evaluation agents compromised Hugging Face production infrastructure while seeking ExploitGym solutions	AI acting on its own Agent misalignment	OpenAI	major	In evaluation
2026-07-08 happened	OpenAI agents built an unauthorized inter-agent message board inside the Artifactory package service	AI acting on its own Agent misalignment	OpenAI	minor	In evaluation
2026-07-08 happened	OpenAI evaluation agents exploited Artifactory zero-days to escape their sandbox and reach the internet	AI acting on its own Agent misalignment	OpenAI	major	In evaluation
2026-06-18 happened	OpenAI evaluation agent breached Services Australia Medicare portal and wrote to government database	AI acting on its own Security compromise	OpenAI	major	In evaluation
2026-05-28 happened	AI agents attempt unauthorized access to Library and Archives Canada website	AI acting on its own Security compromise	OpenAI	negligible	Not stated
2026-05-15 happened	Unreleased OpenAI model used a leaked GitHub API key, attempted disposable-email signups, then fabricated earnings data during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2026-05-13 happened	Agents bypass newspapers.com paywall and Cloudflare bot check via urlquery.net and proxy services	AI acting on its own Security compromise	Not stated	minor	In evaluation
2026-05-11 happened	OpenAI-attributed agents used the dormant German DseWiki as a public message board to share task answers and sandbox bypasses	AI acting on its own Agent misalignment	OpenAI	moderate	In evaluation
2026-05-05 happened	Agent swarm attributed to OpenAI published thousands of RubyGems packages, gained RCE on RubyDoc.info, and attempted API-key theft	AI acting on its own Security compromise	OpenAI	moderate	In training
2026-05-01 happened	OpenAI agents scrape and edit Wikipedia without authorization	AI acting on its own Security compromise	OpenAI	moderate	Not stated
2026-04-25 happened	Cursor coding agent deletes PocketOS production database and backups	AI acting on its own Operational error	Anthropic	major	In production
2026-04-14 happened	Collaborating OpenAI agents uploaded a task workbook to a public file host to share it during RL training	AI acting on its own Security compromise	OpenAI	minor	In training
2025-12-01 happened	Amazon's Kiro agent reportedly deleted and recreated an environment, contributing to a 13-hour AWS Cost Explorer outage	AI acting on its own Operational error	Amazon	major	In production
2025-07-18 happened	Replit AI agent deleted SaaStr's production database during a declared code freeze and stated rollback was impossible	AI acting on its own Operational error	Replit	major	In production
2024-11-02 reported	Character.AI chatbot alleged to have encouraged 14-year-old's suicide (Garcia v. Character.AI)	AI acting on its own Harmful output	Character.AI	severe	In production

Browse incidents by

Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack

Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety

Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)

Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem

Severity: moderate · major · minor · negligible · severe

Where it happened: In production · In evaluation · In training · In research