Serbia Social Card registry automation causes benefit losses for marginalized groups
Serbia implemented a Social Card registry to automate eligibility for social assistance. The system used inaccurate and misclassified data, leading to the loss of benefits for thousands of marginalized people.
The system's reliance on automated processing of data without considering individual circumstances led to the loss of vital assistance.
Key facts
- What
- Serbia implemented a Social Card registry to automate eligibility for social assistance.
- Incident date
- Mar 1, 2022
- Who
- Serbia Ministry of Labour, Employment, Veterans and Social Affairs
- Failure mode
- Data Leakage
- AI surface
- Agentic Workflow
- Severity
- High
What happened
The Serbian government introduced the Social Card registry in March 2022 to streamline the determination of social assistance eligibility. The automation relied on misclassified data, which resulted in thousands of vulnerable citizens losing their benefits. Amnesty International detailed how this system entrenched poverty and discrimination.
What broke inside the model
- 01 · TriggerA request triggers retrieval or context loading.
- 02 · Model stepThe context pulls in another user's content.
- 03 · Control gapNo boundary enforces isolation at the moment of output.
- 04 · FailurePrivate data crosses into the response.
- 05 · ConsequenceOne user sees another's data, and disclosure follows.
One user's content crosses the retrieval boundary into another's response.
The system aggregated data from multiple official registries into a centralized information system. It failed by applying rigid automated logic to inaccurate data without allowing for human correction or consideration of specific life circumstances.
What it cost
Sources
- PrimaryTrapped by Automation: Poverty and discrimination in Serbia's welfare stateamnesty.org
- SocialThe Social Card Registry: Entrenching Poverty and Discrimination in Serbiasocialprotectionfloorscoalition.org
Cite this entry
https://failureindex.ai/failures/serbia-social-card-registry-automation-causesAI Failure Index. "Serbia Social Card registry automation causes benefit losses for marginalized groups" (FI-0245). Realm Labs. https://failureindex.ai/failures/serbia-social-card-registry-automation-causes (indexed Jun 5, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0245. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
Realm can detect when a response is about to emit data that falls outside the bounds of the current user and context, and block or redact it inline, at the moment of generation rather than after the data has left.