Vendors and modelsVendor
Snap AI failures
Every documented AI failure involving Snap on the AI Failure Index, classified by the mechanism that broke.
- Failures
- 4
- Highest severity
- Catastrophic
- Span
- 2023 to 2026
- Failure modes
- 2
Snapchat algorithm allegedly linked minor with sex offenders
A lawsuit alleged that Snapchat's Quick Add recommendation feature connected a 12-year-old girl with convicted sex offenders, leading to sexual assault. A judge dismissed the claims in February 2024, citing Section 230 of the Communications Decency Act.
- Confidence
- Medium (multi-source)
School districts sue Meta, Snap, TikTok, and Google over engagement algorithms
Meta, Snap, TikTok, and Google allegedly used AI recommendation and notification systems to maximize student engagement during school hours. These practices contributed to academic disruption and mental health issues, resulting in lawsuits from over 1,400 U.S. school districts.
- Confidence
- High (multi-source, primary)
Snapchat's My AI gave teens troubling advice and posted on its own
Snapchat's My AI assistant, available to millions of teens, was shown giving minors advice on hiding alcohol smell and setting up an encounter with an older adult, and at one point posted a Story on its own. UK regulators flagged child-privacy concerns.
- Confidence
- Medium (multi-source)
Snap Inc. My AI chatbot produced toxic outputs and faced UK regulatory probe
Snap launched My AI in February 2023, which subsequently produced problematic outputs and hallucinations. This led to an investigation by the UK's ICO regarding child privacy and safety guardrails, and the company acknowledged non-conforming language in internal reviews and outlined safety enhancements.
- Confidence
- High (multi-source, primary)
See how Realm catches these failure modes at runtime.
Book a Demo