Palantir Gotham software in Hesse ruled unconstitutional
The German Federal Constitutional Court ruled in February 2023 that Palantir's Gotham software used by the Hesse State Police violated privacy rights. The court suspended mass data analysis due to insufficient legal safeguards.
The Federal Constitutional Court ruled that automated data analysis without narrow limits violates the right to informational self-determination.
Key facts
- What
- The German Federal Constitutional Court ruled in February 2023 that Palantir's Gotham software used by the Hesse State Police violated privacy rights.
- Incident date
- Feb 16, 2023
- Who
- Palantir
- Failure mode
- Policy Violation
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
The state of Hesse deployed Palantir's Gotham system, branded as hessenDATA, for automated data analysis in policing starting in 2017. Civil rights groups challenged the system's legality, leading to a landmark ruling by the Federal Constitutional Court on February 16, 2023. The court found that the legal basis for the software's use was too broad and violated the right to informational self-determination.
What broke inside the model
- 01 · TriggerA prompt pushes against a deployment boundary.
- 02 · Model stepThe model produces the disallowed output.
- 03 · Control gapNo enforcement blocks it at generation time.
- 04 · FailureThe output crosses the policy line.
- 05 · ConsequenceA limit the business set is breached in public.
The output crosses a policy boundary the deployment had defined.
The failure was a systemic governance and legal compliance issue rather than a technical bug. The software's data mining and profiling mechanisms lacked the constraints required to prevent indiscriminate surveillance. The legal framework failed to maintain a proportional balance between security and civil liberties.
What it cost
Sources
- Court FilingJudgment of 16 February 2023bundesverfassungsgericht.de
- PrimaryBlack box Palantir: To Karlsruhe against mass data miningfreiheitsrechte.org
Cite this entry
https://failureindex.ai/failures/palantir-gotham-software-hesse-ruled-unconstitutionalAI Failure Index. "Palantir Gotham software in Hesse ruled unconstitutional" (FI-0333). Realm Labs. https://failureindex.ai/failures/palantir-gotham-software-hesse-ruled-unconstitutional (indexed Jun 9, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0333. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.