ID.me facial recognition failures lock unemployment beneficiaries out of systems
ID.me deployed a facial recognition system to verify unemployment claimants and prevent fraud. The system's failure to accurately identify many legitimate users led to widespread lockouts and delayed benefit payments.
Facial recognition technology is notoriously less accurate for women and people of color.
Key facts
- What
- ID.me deployed a facial recognition system to verify unemployment claimants and prevent fraud.
- Incident date
- Jun 1, 2022
- Who
- ID.me
- Failure mode
- Identity & Access Drift
- AI surface
- Computer Vision
- Severity
- High
What happened
ID.me's facial recognition system failed to verify the identities of numerous unemployment insurance applicants. This resulted in thousands of legitimate beneficiaries being locked out of their accounts and denied access to critical funds. Many users had to wait weeks for manual verification by a human referee.
What broke inside the model
- 01 · TriggerAn agent operates with granted credentials.
- 02 · Model stepIt reaches for scope it was never assigned.
- 03 · Control gapNo runtime check binds it to its role.
- 04 · FailureThe agent acts outside its authority.
- 05 · ConsequencePrivileged actions run with no oversight.
The agent's actions drift outside the scope it was granted.
The system employed a 1:1 facial matching algorithm to compare a live selfie with a government ID photo. The model failed to correctly match images for many users, a failure attributed to algorithmic bias against women and people of color.
What it cost
Sources
- PressFacial Recognition Failures Are Locking People Out of Unemployment Systemsvice.com
- PressWyden pushes for Oregon and other state unemployment systems to ditch ID.meopb.org
- PrimaryChairs Maloney, Clyburn Release Evidence Facial Recognition Company ID.me Downplayed Excessive Wait Times for Americans Seeking Unemployment Relief Fundsoversightdemocrats.house.gov
Cite this entry
https://failureindex.ai/failures/facial-recognition-failures-lock-unemployment-beneficiaAI Failure Index. "ID.me facial recognition failures lock unemployment beneficiaries out of systems" (FI-0540). Realm Labs. https://failureindex.ai/failures/facial-recognition-failures-lock-unemployment-beneficia (indexed Jun 16, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0540. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- OmniGuard
- AgentRealm
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.