Non-consensual deepfake pornography targets female content creators on subscription sites
Female content creators were targeted by non-consensual deepfake pornography distributed via subscription-based platforms. The incident highlighted the lack of safety guardrails in generative AI tools used to create intimate imagery without consent.
Generative AI was weaponized to create and monetize non-consensual intimate imagery of female creators.
Key facts
- What
- Female content creators were targeted by non-consensual deepfake pornography distributed via subscription-based platforms.
- Incident date
- Jan 30, 2023
- Who
- Unknown
- Failure mode
- Brand & Safety Incident
- AI surface
- Media Generation
- Severity
- High
What happened
Non-consensual deepfake pornography featuring high-profile female streamers was published on subscription-based websites. Victims including Sweet Anita discovered their likenesses were being used to attract paying subscribers. This resulted in significant privacy and safety harms for the creators.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
Generative AI models lacked sufficient safety filters and guardrails to prevent the creation of non-consensual intimate imagery. This allowed users to weaponize face-swapping technology for targeted harassment and financial gain.
What it cost
Sources
- PrimaryTwitch.tv's Deepfake Pornographyvanderbilt.edu
- PressThe deepfake AI porn industry is operating in plain sightnbcnews.com
Cite this entry
https://failureindex.ai/failures/non-consensual-deepfake-pornography-targets-femaleAI Failure Index. "Non-consensual deepfake pornography targets female content creators on subscription sites" (FI-0654). Realm Labs. https://failureindex.ai/failures/non-consensual-deepfake-pornography-targets-female (indexed Jun 22, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0654. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public, in real time rather than after it has been screenshotted.