UK Home Office drops biased visa filtering algorithm
The UK Home Office suspended a visa-streaming tool in August 2020 following allegations of racial bias. The system used nationality to categorize applicants, creating a tiered scrutiny process that disadvantaged specific countries.
Racist feedback loops meant that what should have been a fair migration process was, in practice, just speedy boarding for white people.
Key facts
- What
- The UK Home Office suspended a visa-streaming tool in August 2020 following allegations of racial bias.
- Incident date
- Aug 1, 2020
- Who
- UK Home Office
- Failure mode
- Policy Violation
- AI surface
- Algorithmic Decision
- Severity
- High
What happened
The UK Home Office agreed to stop using a computer algorithm to process visa applications in August 2020. The decision followed a legal challenge from rights groups Foxglove and the Joint Council for the Welfare of Immigrants. Critics alleged the system effectively operated as 'speedy boarding for white people' by fast-tracking certain nationalities.
What broke inside the model
- 01 · TriggerA prompt pushes against a deployment boundary.
- 02 · Model stepThe model produces the disallowed output.
- 03 · Control gapNo enforcement blocks it at generation time.
- 04 · FailureThe output crosses the policy line.
- 05 · ConsequenceA limit the business set is breached in public.
The output crosses a policy boundary the deployment had defined.
The 'streaming' algorithm assigned applicants a color code (green, amber, or red) based on their nationality. A 'secret list' of suspect nationalities automatically triggered red ratings, creating a feedback loop where low success rates for those countries reinforced the suspect list.
What it cost
Sources
- PressHome Office drops 'racist' algorithm from visa decisionsbbc.co.uk
- PressAI system for granting UK visas is biased, rights groups claimtheguardian.com
- PressHome Office climb down on the algorithm for UK visasbindmans.com
Cite this entry
https://failureindex.ai/failures/home-office-drops-biased-visa-filteringAI Failure Index. "UK Home Office drops biased visa filtering algorithm" (FI-0369). Realm Labs. https://failureindex.ai/failures/home-office-drops-biased-visa-filtering (indexed Jun 9, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0369. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm fits
- Prism
- OmniGuard
This entry sits in the index's predictive wing: a system that scores, ranks, perceives, or steers rather than generates. Realm's runtime layer is built for the generative and agentic systems now moving into these same decision seats, where it watches a model's internal state and holds an unsupported claim or an unchecked action before it commits. The control gap on this record, an automated decision that reached people with no runtime check in front of it, is the same gap. The index keeps predictive failures on the record because the pattern carries straight into the systems shipping today.