Dutch government SyRI fraud detection algorithm ruled illegal
The Dutch government used the SyRI algorithm to identify potential social welfare fraud. In February 2020, the District Court of The Hague ruled the system illegal for violating European privacy laws.
The court invalidated the system for breaching the right to privacy under the European Convention on Human Rights.
Key facts
- What
- The Dutch government used the SyRI algorithm to identify potential social welfare fraud.
- Incident date
- Feb 5, 2020
- Who
- Dutch Government
- Failure mode
- Policy Violation
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
The Dutch government deployed the SyRI algorithm to proactively detect social welfare fraud by analyzing large datasets. Civil rights activists challenged the legality of the system's data processing and its lack of transparency. On February 5, 2020, the court ordered an immediate halt to the system.
What broke inside the model
- 01 · TriggerA prompt pushes against a deployment boundary.
- 02 · Model stepThe model produces the disallowed output.
- 03 · Control gapNo enforcement blocks it at generation time.
- 04 · FailureThe output crosses the policy line.
- 05 · ConsequenceA limit the business set is breached in public.
The output crosses a policy boundary the deployment had defined.
The system failed due to a lack of legal proportionality and transparency. It violated Article 8 of the European Convention on Human Rights by infringing upon the right to privacy of citizens.
What it cost
Sources
- PrimaryHow Dutch activists got an invasive fraud detection algorithm bannedalgorithmwatch.org
- PressDigital welfare fraud detection and the Dutch SyRI judgmentiapp.org
Cite this entry
https://failureindex.ai/failures/dutch-government-syri-fraud-detection-algorithmAI Failure Index. "Dutch government SyRI fraud detection algorithm ruled illegal" (FI-0325). Realm Labs. https://failureindex.ai/failures/dutch-government-syri-fraud-detection-algorithm (indexed Jun 9, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0325. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.