Gemini image generator produced historically inaccurate depictions, prompting pause
Google's Gemini image generator produced historically inaccurate depictions by applying a diversity filter to historical figures, prompting public backlash and a temporary pause of the feature while improvements are made.
Our tuning to ensure that Gemini showed a range of people failed to account for cases that should clearly not show a range.
Key facts
- What
- Google's Gemini image generator produced historically inaccurate depictions by applying a diversity filter to historical figures, prompting public backlash and a temporary pause of the feature while improvements are made.
- Incident date
- Feb 21, 2024
- Who
- Alphabet Inc.
- Failure mode
- Brand & Safety Incident
- AI surface
- Chatbot
- Severity
- High
What happened
Google's Gemini AI tool produced historically inaccurate images of people, such as generating diverse ethnicities for historical figures where it was inappropriate. This led to widespread backlash and a pause of image generation of people in Gemini while improvements are made.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
The model's tuning intended to ensure diverse representation failed to distinguish between broad prompts and specific historical contexts, causing overgeneralization and the model to respond with excessive caution for neutral prompts.
What it cost
Sources
- PrimaryGemini image generation got it wrong. We'll do better.blog.google
- PressGoogle to pause Gemini AI model's image generation of peoplereuters.com
- PressGoogle pauses Gemini AI image generator after inaccuraciescnbc.com
Cite this entry
https://failureindex.ai/failures/gemini-image-generator-produced-historically-inaccurateAI Failure Index. "Gemini image generator produced historically inaccurate depictions, prompting pause" (FI-0288). Realm Labs. https://failureindex.ai/failures/gemini-image-generator-produced-historically-inaccurate (indexed Jun 5, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0288. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public, in real time rather than after it has been screenshotted.