Alibaba: AI incidents
What has gone wrong with AI systems, where, and how badly.
2 of 131 incidents
Risk groupings are set by a model from sentences quoted from each incident's sources. On 2026-10-24 a second model (deepseek-reasoner) classified 55 incidents without seeing those answers: it chose the same grouping for 36; for 10 one of the two left a question unanswered; 9 differ.
| Date | Incident | Risk grouping | Developer | Severity | Where it happened |
|---|---|---|---|---|---|
| 2026-10-27 reported |
Qwen3.8-Flash-Next attempts outbound file upload to Beijing server during Cohere cybersecurity evaluation | Not yet classified Security compromise | Alibaba | minor | In evaluation |
| 2026-10-21 reported |
RL-trained agent on Alibaba AI engine team mined cryptocurrency on training server and opened reverse SSH tunnel to external IP | AI acting on its own Agent misalignment | Alibaba | minor | In training |
Browse incidents by
Risk grouping: AI acting on its own · AI used to exploit · Not yet classified · AI attacked · AI failing in normal use · Misuse by its own users · Harm by design · Supply chain attack
Kind of failure: Security compromise · Agent misalignment · Harmful output · Operational error · Privacy leak · Other kind · Hallucination · IP infringement · Physical safety
Developer: OpenAI · Anthropic · Google · Meta · Alibaba · Amazon · Character.AI · DeepSeek · Tesla · Waymo · xAI · Amazon Web Services · Character Technologies, Inc. · Replit · Salesforce · Tencent · TypeSafe AI · Univerads Technology Limited · Z.ai (Zhipu AI)
Sector: Information · Finance and Insurance · Retail Trade · Software Publishers · Public administration · technology · Transportation and Warehousing · AI platform / intermediary services · AI safety research · Artificial intelligence research and development · Arts, Entertainment, and Recreation · Autonomous vehicle / robotaxi transportation · Cloud computing · critical infrastructure and e-commerce · CRM software · Cybersecurity · education · Educational Services · Fitness and recreational sports centers · Food Manufacturing · Government AI safety and security evaluation · government AI safety evaluation · Healthcare and government · Information Security research · Insurance · Open knowledge platform / nonprofit encyclopedia · political campaigns · Public administration and government · Retail · Retail Trade; Transportation and Warehousing; Finance and Insurance · Scientific research and light source user facility · Software / AI coding tools · Software publishing / npm ecosystem
Severity: moderate · major · minor · negligible · severe
Where it happened: In production · In evaluation · In training · In research