Beverly Hills middle school students expelled for creating deepfake nudes
In February 2024, students at a Beverly Hills middle school used generative AI to create and share deepfake nude photos of their peers. The school expelled five students involved in the incident, highlighting risks associated with the availability of powerful image generation tools.
The incident highlights how generative AI can be weaponized to create non-consensual sexual imagery for cyberbullying.
Key facts
- What
- In February 2024, students at a Beverly Hills middle school used generative AI to create and share deepfake nude photos of their peers.
- Incident date
- Feb 27, 2024
- Who
- Unknown
- Failure mode
- Brand & Safety Incident
- AI surface
- Chatbot
- Severity
- High
What happened
Five eighth-grade students at Beverly Vista Middle School in Beverly Hills were expelled for using AI to create and distribute non-consensual nude images of their classmates. The incident involved the creation of explicit deepfakes from existing photos. Both the school district and the Beverly Hills Police Department launched investigations into the matter.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
The AI tools used lacked sufficient safety guardrails to prevent the generation of non-consensual intimate imagery (NCII). This allowed users to bypass ethical constraints and transform benign images into sexually explicit content.
What it cost
Sources
- PressBeverly Hills school expels students over deepfake nude photosnbcnews.com
- PressBeverly Hills school district expels 8th graders involved in fake nude scandallatimes.com
- PressStudents share AI-generated nude photos of classmatesfoxla.com
- PressAI-generated nude photos of students from a Beverly Hills middle school were circulated by classmatesktla.com
Cite this entry
https://failureindex.ai/failures/beverly-hills-middle-school-students-expelledAI Failure Index. "Beverly Hills middle school students expelled for creating deepfake nudes" (FI-0627). Realm Labs. https://failureindex.ai/failures/beverly-hills-middle-school-students-expelled (indexed Jun 22, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0627. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm watches the model's internal state for the signature of unsafe or off-brand generation and can block or reroute the output before it becomes public, in real time rather than after it has been screenshotted.