Brazil AI welfare app wrongly rejects benefit claims
The Brazilian National Social Security Institute's AI-powered app, Meu INSS, wrongly denied benefit claims for hundreds of applicants. The system struggled with complex cases and rural users with low digital literacy, leading to a loss of essential income.
The AI system's design prioritizes speed and cost-saving over user accessibility and fairness, leading to automatic rejections of complex cases.
Key facts
- What
- The Brazilian National Social Security Institute's AI-powered app, Meu INSS, wrongly denied benefit claims for hundreds of applicants.
- Incident date
- Apr 24, 2025
- Who
- National Social Security Institute (INSS)
- Failure mode
- Agentic Action Error
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
Brazil's National Social Security Institute (INSS) deployed an AI-powered app, Meu INSS, to automate the processing of welfare claims. While increasing efficiency for simple cases, the system wrongly denied hundreds of claims, particularly for rural residents and those with low digital literacy. These individuals faced a loss of essential income and were often forced to seek legal recourse.
What broke inside the model
- 01 · TriggerAn agent plans a multi-step task.
- 02 · Model stepIt chooses a wrong or destructive action.
- 03 · Control gapNo confirmation gate guards the write.
- 04 · FailureThe action commits to a system of record.
- 05 · ConsequenceData is changed or destroyed irreversibly.
A wrong action commits, and the step is written before anything can stop it.
The system utilized rigid decision rules and relied on existing databases that misinterpreted ambiguous or incomplete information. Due to a lack of human oversight, the AI was unable to account for the complexities of atypical cases. This resulted in automatic rejections for minor errors that a human reviewer would typically resolve.
What it cost
Sources
- PressBrazil's AI-powered social security app is wrongly rejecting claimsrestofworld.org
- PressRobôs do INSS e o indeferimento automático de benefíciosmigalhas.com.br
- PrimaryBrazil AI-powered welfare app accused of unfairly denying claimsaiaaic.org
Cite this entry
https://failureindex.ai/failures/brazil-welfare-wrongly-rejects-benefit-claimsAI Failure Index. "Brazil AI welfare app wrongly rejects benefit claims" (FI-0466). Realm Labs. https://failureindex.ai/failures/brazil-welfare-wrongly-rejects-benefit-claims (indexed Jun 10, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0466. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
- AgentRealm
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.