OpenAI's Sora app filled with nonconsensual deepfakes of real people at launch
OpenAI's Sora video app launched with a feed full of hyper-real AI videos, including nonconsensual depictions of real, recognizable people and deceased public figures, prompting takedowns, opt-out demands from estates, and rapid policy changes.
The video app's feed filled with realistic, nonconsensual depictions of real and deceased people at launch.
Key facts
- What
- OpenAI's Sora video app launched with a feed full of hyper-real AI videos, including nonconsensual depictions of real, recognizable people and deceased public figures, prompting takedowns, opt-out demands from estates, and rapid policy changes.
- Incident date
- Oct 3, 2025
- Who
- OpenAI
- Failure mode
- Brand & Safety Incident
- AI surface
- Search / RAG
- Severity
- High
What happened
When OpenAI launched the Sora app in October 2025, users quickly generated realistic videos of real and dead public figures without consent, raising likeness and misinformation concerns. OpenAI added guardrails and opt-outs under pressure from estates and rights holders, but the launch showed a generative-video product reaching the public faster than its safety controls.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
The system produced output that was toxic, defamatory, dangerous, or off-brand, and it became public. The model generated what was statistically plausible, and no runtime check caught the unsafe output before it reached an audience.
What it cost
Takedowns, estate opt-outs, and emergency policy changes
Sources
Cite this entry
https://failureindex.ai/failures/openai-sora-app-filled-nonconsensual-deepfakesAI Failure Index. "OpenAI's Sora app filled with nonconsensual deepfakes of real people at launch" (FI-0075). Realm Labs. https://failureindex.ai/failures/openai-sora-app-filled-nonconsensual-deepfakes (indexed Jun 3, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0075. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public.