An AI tenant-screening tool settled for $2.28M over discriminatory scoring
SafeRent settled for $2.28 million after a lawsuit alleged its AI screening score disproportionately harmed Black and Hispanic applicants using housing vouchers. As part of the settlement SafeRent agreed to stop showing its score for voucher applicants nationwide.
The settlement bars SafeRent from showing its algorithmic score for applicants who use housing vouchers nationwide.
Key facts
- What
- SafeRent settled for $2.28 million after a lawsuit alleged its AI screening score disproportionately harmed Black and Hispanic applicants using housing vouchers.
- Incident date
- Nov 20, 2024
- Who
- SafeRent Solutions
- Failure mode
- Policy Violation
- AI surface
- Agentic Workflow
- Severity
- High
What happened
Massachusetts renters alleged SafeRent's algorithmic tenant score disproportionately rejected Black and Hispanic applicants who used housing vouchers. In 2024 SafeRent agreed to a $2.28 million settlement and, for five years, to stop displaying its score or accept/deny recommendations for voucher applicants nationwide, requiring landlords to evaluate applicants more holistically.
What broke inside the model
- 01 · TriggerA prompt pushes against a deployment boundary.
- 02 · Model stepThe model produces the disallowed output.
- 03 · Control gapNo enforcement blocks it at generation time.
- 04 · FailureThe output crosses the policy line.
- 05 · ConsequenceA limit the business set is breached in public.
The output crosses a policy boundary the deployment had defined.
The system produced an output or action that broke a stated company policy or a regulation that applied to the deployment. The model optimized for a plausible response, not for the constraint, and no enforcement layer checked the output against the policy before it took effect.
What it cost
$2.28M settlement; product change nationwide
Sources
- PressRental Applicants Reach $2.28M Settlement Over Discriminatory AI Screening (Cohen Milstein)cohenmilstein.com
- PressSafeRent's $2.3 Million Deal in AI Screening Tool Suit Approved (Bloomberg Law)news.bloomberglaw.com
Cite this entry
https://failureindex.ai/failures/ai-tenant-screening-tool-settled-2AI Failure Index. "An AI tenant-screening tool settled for $2.28M over discriminatory scoring" (FI-0041). Realm Labs. https://failureindex.ai/failures/ai-tenant-screening-tool-settled-2 (indexed Jun 3, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0041. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
Realm compares what the model is about to output or do against the policy that governs the deployment, in real time, and can deny or redact the action before it takes effect, which is the gap an after-the-fact review never closes in time.