Uber Real-Time ID Check deactivates transgender drivers for appearance changes
Uber's facial recognition system mistakenly deactivated transgender drivers whose appearances changed during gender transition. The system flagged these drivers as potential fraud cases due to the discrepancy between their current appearance and their government IDs.
Uber's facial recognition system incorrectly flagged transgender drivers as fraudulent when their current appearance didn't match their ID photos.
Key facts
- What
- Uber's facial recognition system mistakenly deactivated transgender drivers whose appearances changed during gender transition.
- Incident date
- Jul 4, 2018
- Who
- Uber
- Failure mode
- Identity & Access Drift
- AI surface
- Computer Vision
- Severity
- Medium
What happened
Transgender Uber drivers reported being suspended or permanently deactivated from the platform due to the Real-Time ID Check security feature. The system flagged drivers whose appearances had changed during their gender transition, leading to automatic account suspensions. This caused many drivers to lose their primary source of income.
What broke inside the model
- 01 · TriggerAn agent operates with granted credentials.
- 02 · Model stepIt reaches for scope it was never assigned.
- 03 · Control gapNo runtime check binds it to its role.
- 04 · FailureThe agent acts outside its authority.
- 05 · ConsequencePrivileged actions run with no oversight.
The agent's actions drift outside the scope it was granted.
The system used a Microsoft-powered facial recognition model to compare a driver's live selfie with their government ID photo. The model failed to recognize the same individual after an appearance change due to gender transition, resulting in false positive fraud alerts.
What it cost
Sources
- PressSome transgender drivers are being kicked off Uber's appcnbc.com
- PressUber driver troubles raise concerns about transgender face recognitionfastcompany.com
- PressTransgender Uber drivers say app's new security features get them suspendedmetroweekly.com
Cite this entry
https://failureindex.ai/failures/uber-real-time-check-deactivates-transgenderAI Failure Index. "Uber Real-Time ID Check deactivates transgender drivers for appearance changes" (FI-0678). Realm Labs. https://failureindex.ai/failures/uber-real-time-check-deactivates-transgender (indexed Jun 22, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0678. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- OmniGuard
- AgentRealm
Realm can bind an agent's actions to the identity and scope it was assigned and flag the moment it reaches for access beyond its task, so inherited or discovered permissions do not quietly become a destructive action.