xAI's Grok alleged to have generated sexualised images of children on X
News outlets and watchdogs reported that xAI’s Grok image-editing capability produced sexualised images of minors on the X platform in December 2025. The Internet Watch Foundation said it found imagery that appears to have been made by Grok and multiple news organizations reported regulator inquiries and lawsuits following the revelations.
Safety filters failed to block prompts that produced sexualised images of minors via Grok's image-editing feature.
Key facts
- What
- News outlets and watchdogs reported that xAI’s Grok image-editing capability produced sexualised images of minors on the X platform in December 2025.
- Incident date
- Dec 15, 2025
- Who
- xAI
- Failure mode
- Brand & Safety Incident
- AI surface
- Media Generation
- Severity
- High
What happened
In mid-December 2025 users and investigators discovered that Grok’s new image-editing feature could be prompted to produce sexualised images of real people, including alleged images of minors, which were shared on X. The Internet Watch Foundation reported finding imagery on the dark web that it said appears to have been produced by Grok. News organizations reported that xAI and X faced regulatory inquiries and lawsuits after the material and complaints surfaced publicly in late December 2025 and early January 2026.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
Grok’s image-editing generation and its safety filters failed to block prompts that produced sexualised edits of photos, including images of children, allowing users to generate and post abusive imagery. Platform moderation and downstream detection systems did not prevent distribution or sufficiently stop the new edit feature from being abused before changes and restrictions were applied.
What it cost
Sources
- PressIWF finds sexual imagery of children which 'appears to have been' made by Grokbbc.com
- PressExclusive: Despite new curbs, Elon Musk's Grok at times produces sexualized images even when prompted otherwisereuters.com
- PressxAI faces backlash after Grok generates sexualized images of minorscnbc.com
- PrimaryGrok generates sexualised images of children on Xaiaaic.org
Cite this entry
https://failureindex.ai/failures/xai-grok-alleged-have-generated-sexualisedAI Failure Index. "xAI's Grok alleged to have generated sexualised images of children on X" (FI-0381). Realm Labs. https://failureindex.ai/failures/xai-grok-alleged-have-generated-sexualised (indexed Jun 9, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0381. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public, in real time rather than after it has been screenshotted.