AI Risk WireCases › produced harmful content › LR-2026-0846
Alleged harmful advice and unsafe release of Snapchat My AI chatbot, per West Virginia AG lawsuit against Snap Inc.
Also listed as: AI lawsuits
Preliminary Why: Publisher not yet named · subject to change
Developing: a major or severe case captured in the last 72 hours. Later changes are logged on the corrections page.
Status: no action reported
No source states: money lost or records count, could do, deployer, industry.
Severity major: tier, on the test that a regulator is involved: the West Virginia Attorney General filed the lawsuit against Snap Inc. No loss figure is stated.
West Virginia’s attorney general sued Snap Inc. over concerns about the My AI chatbot in Snapchat. Snap released My AI to all users, including children, on April 19, 2023, after first testing it with Snapchat+ subscribers. Outside testing cited in the complaint found the chatbot gave advice about hiding alcohol and marijuana use to someone claiming to be 15. It also allegedly gave sexual advice to a user claiming to be 12 and planning to meet a 31-year-old man. The state alleges the chatbot was released to children without enough safety testing. The state is seeking civil penalties, a permanent injunction and court-ordered safety changes.
What happened
No source tells the story step by step yet.
What was done
No source states an action or fix.
Risks
Primary68 incidents
Rising: 5 vs 2.5 a week
Sorted by rule from the case's fields; not yet read from the sources.
Controls
Not yet read for controls. Controls that mitigate the primary risk:
ModelSafety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming
ApplicationSimilar incidents
Evidence
- Legal action a case filed
No source states: a step-by-step account, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, the cause, what set it off, what was done.
Show every field, with its source and grade
The AI system
What happened
Impact
Context
Notes on gaps
Excluded: the Bryce Tate (2025-11-06) and Cimarron Thomas (2018) sextortion cases, which involve a human perpetrator on Snapchat with no AI system described. Excluded: platform moderation and design claims (96.7% of reported accounts unreviewed, 86.3% of flagged content expired, Streaks, Snapscores, endless feeds) because no AI system is attributed to them as acting. Also not separate incidents: the allegations that My AI conversations are shared with OpenAI, that content goes to Microsoft Advertising, and that My AI can access location under Ghost Mode. Agent flag is false: My AI is described as a chatbot with no tools or autonomous actions. Extractor proposed values without quotes; dropped: .
LR-2026-0846 · version 1 · published 2026-11-06 after automatic checks; not yet checked field by field by a person · JSON