Buenos Aires facial recognition system causes numerous wrongful arrests
The City of Buenos Aires implemented an AI facial recognition system for public security that resulted in over 140 false identifications and wrongful detentions. This led to a legal battle and a court ruling that declared the program's implementation unconstitutional.
At least 140 innocent people had also been stopped by police because the system recognized them as wanted criminals.
Key facts
- What
- The City of Buenos Aires implemented an AI facial recognition system for public security that resulted in over 140 false identifications and wrongful detentions.
- Incident date
- Jan 1, 2019
- Who
- Buenos Aires City Government
- Failure mode
- Hallucination
- AI surface
- Computer Vision
- Severity
- High
What happened
The Buenos Aires City Government deployed a facial recognition system in 2019 to identify fugitives using city-wide video surveillance. At least 140 individuals were erroneously flagged as criminals, resulting in wrongful police stops and detentions. Some victims, such as Guillermo Ibarrola, were incarcerated for several days before their innocence was established.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
The system produced false positives by incorrectly matching live video feeds against a national fugitive database. These database errors and identity mismatches led the AI to flag innocent citizens as wanted criminals.
What it cost
Sources
- PressHow We Investigated Mass Surveillance in Argentinapulitzercenter.org
- PressIncident 829: Facial Recognition System in Buenos Aires Triggers Police Checks Based on False Matchesincidentdatabase.ai
Cite this entry
https://failureindex.ai/failures/buenos-aires-facial-recognition-causes-numerousAI Failure Index. "Buenos Aires facial recognition system causes numerous wrongful arrests" (FI-0445). Realm Labs. https://failureindex.ai/failures/buenos-aires-facial-recognition-causes-numerous (indexed Jun 10, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0445. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.