Meta AI hallucinates sexual harassment allegations against New York lawmakers
Meta's AI chatbot in Facebook Messenger fabricated detailed sexual harassment allegations against various New York state legislators. The hallucinations included fake investigations and punishments, prompting calls for legislative AI disclosure requirements.
The Meta AI chatbot fabricates sexual harassment allegations against sitting lawmakers.
Key facts
- What
- Meta's AI chatbot in Facebook Messenger fabricated detailed sexual harassment allegations against various New York state legislators.
- Incident date
- Apr 1, 2024
- Who
- Meta
- Failure mode
- Hallucination
- AI surface
- Chatbot
- Severity
- High
What happened
Meta AI generated completely false claims that sitting New York state lawmakers had been accused of sexual harassment. The chatbot provided detailed narratives of nonexistent investigations and disciplinary actions, such as being stripped of committee assignments. This failure affected multiple lawmakers, including those overseeing AI legislation in the state.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
The Meta AI chatbot suffered from hallucinations where it generated plausible but false defamatory content. The model failed to verify the truth of the claims and instead fabricated detailed stories that shared striking similarities across different prompts.
What it cost
Sources
- PressMeta AI falsely claims lawmakers were accused of sexual harassmentcityandstateny.com
- PressN.Y. lawmaker wants AI disclosure after chatbot false claimspluribusnews.com
Cite this entry
https://failureindex.ai/failures/meta-hallucinates-sexual-harassment-allegations-yorkAI Failure Index. "Meta AI hallucinates sexual harassment allegations against New York lawmakers" (FI-0641). Realm Labs. https://failureindex.ai/failures/meta-hallucinates-sexual-harassment-allegations-york (indexed Jun 22, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0641. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.