Social Health Authority AI premiums overcharge poorest Kenyans
Kenya's Social Health Authority deployed an AI-driven predictive model to set health insurance premiums based on income. An investigation found the system systematically overcharged the poorest citizens, effectively denying them access to healthcare.
Our findings reveal in unprecedented detail how, from the start, it was designed to systematically overcharge the poorest Kenyans, while undercharging the wealthiest.
Key facts
- What
- Kenya's Social Health Authority deployed an AI-driven predictive model to set health insurance premiums based on income.
- Incident date
- May 4, 2026
- Who
- Social Health Authority
- Failure mode
- Brand & Safety Incident
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
The Social Health Authority (SHA) implemented a machine learning system to predict household incomes and determine health insurance premiums. The system systematically overcharged the poorest citizens while undercharging the wealthy. This led to many low-income individuals losing access to life-saving medical treatment because they could not afford the AI-determined premiums.
What broke inside the model
- 01 · TriggerA user prompts the model in public view.
- 02 · Model stepThe model produces unsafe or off-brand output.
- 03 · Control gapNo filter holds the line before publish.
- 04 · FailureThe output goes public unchecked.
- 05 · ConsequenceA reputational or safety incident lands.
A contained signal crosses into output that goes public.
The predictive model was trained on a 2020 household survey and used lifestyle indicators like roof and toilet types to estimate income. These indicators failed to accurately reflect current economic realities, creating a systematic bias that overestimated the income of the poorest citizens.
What it cost
Sources
- PressHiding Behind AI - Lighthouse Reportslighthousereports.com
- PressFlaws in Kenya’s AI-driven health reforms driving up costs for the pooresttheguardian.com
- PressAI on Shaky Ground: Why Africa Isn't Ready for Algorithmic Governancetheboldeastafrica.com
Cite this entry
https://failureindex.ai/failures/social-health-authority-premiums-overcharge-poorestAI Failure Index. "Social Health Authority AI premiums overcharge poorest Kenyans" (FI-0575). Realm Labs. https://failureindex.ai/failures/social-health-authority-premiums-overcharge-poorest (indexed Jun 16, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0575. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.