AI Risk Wire

Cases › produced harmful content › LR-2026-0804

Man's AI diet advice linked to hospital stay, exposing a blind spot

Preliminary Why: Publisher not yet named · subject to change

Status: no action reported

Severity minor
Reported 18 Oct 2026
Developer and model OpenAI

No source states: loss or records, agent tool, could do, deployer, industry.

A 60-year-old man asked ChatGPT for ways to reduce chloride in his diet and, following its dietary advice, replaced table salt with sodium bromide. He later developed hallucinations and paranoia and required hospital treatment. The chatbot conversation could not be retrieved, so doctors were unable to determine exactly what advice he had received. The case was detailed in a paper by researchers from Binghamton University, Stanford University, Texas A&M University and Indiana University, which argues that the lack of transparency around AI-generated health advice makes such cases hard to investigate. OpenAI said ChatGPT is not a doctor and should never be used as a substitute for medical care, diagnosis, or treatment. The authors also recommend creating systems that allow AI-generated health guidance to be flagged, reported and examined.

What happened

1 · What went wrongHe later developed hallucinations and paranoia and required hospital treatment.

What was done

No source states an action or fix.

Risks

Harmful content and jailbreaks
Primary
84 incidents
Rising: 6 vs 3.8 a week

Sorted by rule from the case's fields; not yet read from the sources.

Controls

Not yet read for controls. Controls that mitigate the primary risk:

Model

Safety training and refusal · Content safety classifiers · Abuse monitoring and account enforcement · Outside red-teaming

Application

Output filtering and redaction

Similar incidents

All cases of this kind ›

Evidence

No source states: what the AI was doing, what it reached or did, how it was caught, when it happened, when it was found, how many records were exposed, the direct loss, a count of the other parties affected, any court case, the cause, what set it off, what was done.

Show the full account: 4 items from the primary sources

What happened, in order

Not dated in the sources:

  • Man replaces table salt with sodium bromide after seeking ways to reduce chloride in his diet.
  • He later develops hallucinations and paranoia and requires hospital treatment.
  • Doctors cannot retrieve the chatbot conversation or determine the advice he received.
  • Researchers publish a paper detailing the case and arguing for greater transparency about AI health advice.
Show every field, with its source and grade

The AI system

Developer
OpenAI
C one secondary source states it
What it was for
Not intended for medical diagnosis or treatment, per the developer's terms
C one secondary source states it

What happened

Earliest source we hold
2026-10-18
D inferred by us from the described behaviour, reason shown
What went wrong
produced harmful content
D inferred by us from the described behaviour, reason shown

Impact

Severity
minor
D inferred by us from the described behaviour, reason shown
Kind of harm
bodily harm
C one secondary source states it

Notes on gaps

The F1 link is an inference from the statement that the conversation could not be retrieved; the sources do not name a logging control. The remediation is the researchers' advice, not a change made by a party. The Gallup survey figure concerns other people and is not used as incident data.

LR-2026-0804 · version 1 · published 2026-11-01 after automatic checks; not yet checked field by field by a person · JSON