TikTok algorithm exposed young users to pro-eating disorder content
TikTok's algorithmic recommendation system allegedly promoted pro-eating disorder content to minors. This occurred despite official policies banning such material, highlighting a failure in content filtering and safety guardrails.
Records by entity: ByteDance
TikTok's For You algorithm amplified pro-eating disorder content for young users, bypassing safety guidelines.
The algorithm pushed users down a content rabbit hole, amplifying harmful pro-disorder material.
Key facts
- What
- TikTok's algorithmic recommendation system allegedly promoted pro-eating disorder content to minors.
- Incident date
- Jul 1, 2022
- Who
- TikTok
- Failure mode
- Brand & Safety Incident
- AI surface
- Recommender
- Severity
- High
What happened
TikTok's For You page allegedly recommended videos promoting eating disorders to young users. These recommendations occurred despite community guidelines prohibiting such content. Research indicated that the algorithm actively boosted harmful material for teenage users.
What broke inside the model
The recommendation system created narrow feedback loops that led users down content rabbit holes. The algorithm failed to filter guideline-violating material when it predicted high user engagement with extreme content.
What it cost
Sources
- PrimaryIncident 279: TikTok's “For You” Algorithm Exposed Young Users to Pro Disorder Contentincidentdatabase.ai
- PressReport: TikTok boosts posts about eating disorders, suicideapnews.com
Cite this entry
https://failureindex.ai/failures/tiktok-algorithm-exposed-young-pro-eatingAI Failure Index. "TikTok algorithm exposed young users to pro-eating disorder content" (FI-0414). Realm Labs. https://failureindex.ai/failures/tiktok-algorithm-exposed-young-pro-eating (indexed Jun 10, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0414. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.