Vendors and modelsDeployer

Unspecified / healthcare deployer AI failures

Every documented AI failure involving Unspecified / healthcare deployer on the AI Failure Index, classified by the mechanism that broke.

Failures
1
Highest severity
High
Span
2023
Failure modes
1
By failure mode
By severity
FI-0425HealthcareHigh
Hallucination

Large language models perpetuate racial bias in healthcare

AIAAIC recorded an incident entry (published November 2023) documenting that large language models (LLMs) have produced racially biased outputs in healthcare contexts. Independent academic audits and studies (including a 2024 audit titled "Unmasking and Quantifying Racial Bias of Large Language Models") found LLMs gave systematically different clinical-related recommendations and projections across racial groups. These outputs have the potential to cause harm when used in clinical decision-making by healthcare deployers.

Confidence
High (multi-source, primary)
Unspecified / healthcare deployer3 sourcesPrimaryPublicNov 2023

See how Realm catches these failure modes at runtime, before they reach production.

Explore Realm Labs