AI-generated foraging books on Amazon gave potentially deadly mushroom advice
Amazon was flooded with AI-generated books, including wild-mushroom foraging guides that experts warned contained dangerous, inaccurate advice that could lead a reader to eat a poisonous mushroom. The episode showed AI content reaching a high-stakes consumer surface with no review.
AI-generated foraging guides gave confident but wrong advice that could lead a reader to eat a poisonous mushroom.
Key facts
- What
- Amazon was flooded with AI-generated books, including wild-mushroom foraging guides that experts warned contained dangerous, inaccurate advice that could lead a reader to eat a poisonous mushroom.
- Incident date
- Sep 1, 2023
- Who
- Amazon
- Failure mode
- Brand & Safety Incident
- AI surface
- Search / RAG
- Severity
- Medium
What happened
In 2023 mycologists and journalists found a wave of apparently AI-generated foraging guides for sale on Amazon, some with confidently wrong identification advice that could cause a reader to pick and eat a poisonous mushroom. Experts called the books dangerous, and Amazon removed several as scrutiny of AI-generated books on its store grew.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
The system produced output that was toxic, defamatory, dangerous, or off-brand, and it became public. The model generated what was statistically plausible for the prompt, and no runtime check caught the unsafe output before it reached a real audience.
What it cost
Dangerous content reached consumers; titles removed
Sources
Cite this entry
https://failureindex.ai/failures/ai-generated-foraging-books-amazon-gaveAI Failure Index. "AI-generated foraging books on Amazon gave potentially deadly mushroom advice" (FI-0064). Realm Labs. https://failureindex.ai/failures/ai-generated-foraging-books-amazon-gave (indexed Jun 3, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0064. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public, in real time rather than after it has been screenshotted.