Gaggle surveillance alert leads to arrest and detention of 13-year-old student
A 13-year-old student at Fairview Middle School in Tennessee was arrested and detained overnight after Gaggle AI surveillance software flagged a comment in her school email chat. The incident, which occurred in August 2023, was later identified as a false alarm.
Records by entity: Gaggle
Gaggle's AI flagged a student's chat as a threat, resulting in her arrest and overnight detention.
A false AI alert triggered the arrest and overnight detention of a 13-year-old student.
Key facts
- What
- A 13-year-old student at Fairview Middle School in Tennessee was arrested and detained overnight after Gaggle AI surveillance software flagged a comment in her school email chat.
- Incident date
- Aug 15, 2023
- Who
- Gaggle
- Failure mode
- Brand & Safety Incident
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
In August 2023, a 13-year-old student at Fairview Middle School in Tennessee was arrested, strip-searched, and detained overnight. The arrest was triggered by an AI alert from Gaggle, which monitors student communications on school accounts. The flag was later determined to be a false alarm.
What broke inside the model
The Gaggle AI incorrectly identified a chat message as a threat, creating a false positive alert. This failure in classification triggered an automated notification to school authorities, who then initiated law enforcement action.
What it cost
Sources
- PressStudents have been arrested for AI surveillance false alarmsnbcmiami.com
- PressStudents have been called to the office , and even arrestedwusf.org
- Pressand even arrested , for AI surveillance false alarmsapnews.com
Cite this entry
https://failureindex.ai/failures/gaggle-surveillance-alert-leads-arrest-detentionAI Failure Index. "Gaggle surveillance alert leads to arrest and detention of 13-year-old student" (FI-0700). Realm Labs. https://failureindex.ai/failures/gaggle-surveillance-alert-leads-arrest-detention (indexed Jun 22, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0700. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.