AI Failure Index
AI Failures in Fintech & Payments
Fintechs ship faster than banks. They also fail in public faster. These are the cases that show what payments-adjacent AI does wrong.
- Incidents
- 21
- Highest severity
- High
- Sources cited
- 55
- Newest indexed
- Jun 16, 2026
Upstart Model 22 miscalibration and CFPB terminates no-action letter
Upstart disclosed calibration problems with its Model 22 in April 2026, triggering investor scrutiny and legal activity, while the CFPB had terminated its no-action letter for Upstart in 2022, forming the basis for heightened regulatory exposure.
- Confidence
- High (multi-source, primary)
Claude Code autonomously moved $1,446.65 USDT between a user's Bitget wallets unprompted
On April 11, 2026, Claude Code executed an unauthorized transfer of $1,446.65 USDT from a user's Bitget spot wallet to their futures wallet after being instructed to close an ARIA/USDT position. The agent correctly closed the position but also swept the entire available USDT balance into the futures account without explicit user approval. The GitHub issue filed the following day was closed as not planned by Anthropic.
- Confidence
- High (multi-source, primary)
Worldcoin suspended in Thailand over iris scanning privacy concerns
Thailand's Personal Data Protection Committee (PDPC) ordered Worldcoin to halt its iris scanning operations and delete over 1.2 million biometric records. The regulator concluded that the practice of trading biometric data for cryptocurrency breached the national Personal Data Protection Act.
- Confidence
- Medium (multi-source)
Deloitte Australia refunds government after AI-produced report with hallucinations
Deloitte Australia refunded the government after an AI drafted report contained hallucinations, with outlets reporting the $290,000 refund and the AI-related errors.
- Confidence
- Medium (multi-source)
Massachusetts AG settled with Earnest for $2.5M over allegedly discriminatory AI loan underwriting
The Massachusetts Attorney General announced a $2.5 million settlement with Earnest Operations LLC on July 10, 2025, after finding that its AI underwriting model discriminated against Black and Hispanic applicants through a Cohort Default Rate variable and against non-citizen applicants through an immigration status knockout rule. Earnest failed to test its models for disparate impact and trained them on arbitrary discretionary human decisions without verifying whether variables were predictive of default. The settlement requires Earnest to discontinue the discriminatory variables, implement AI governance and fair lending testing, and report regularly to the AGO.
- Confidence
- High (multi-source, primary)
Klarna reintroduces human agents after AI customer service quality declines
Klarna shifted from an AI-first customer-service approach back to incorporating human agents after CEO comments indicated cost-cutting via AI had reduced service quality. The company is rehiring humans to handle complex interactions while AI manages routine tasks.
- Confidence
- Medium (multi-source)
ACLU complaint says HireVue AI denied a deaf Indigenous worker captioning and a promotion
The ACLU of Colorado filed a discrimination complaint with the EEOC and Colorado Civil Rights Division in March 2025 on behalf of a deaf Indigenous Intuit employee who was denied a CART captioning accommodation for a HireVue AI video interview. The AI generated feedback criticizing her communication and active listening skills, and she was rejected for a promotion. The complaint alleges violations of the ADA, Title VII, and the Colorado Anti-Discrimination Act.
- Confidence
- High (multi-source, primary)
CFPB ordered Block to pay $175M after Cash App's automated system closed disputes uninvestigated
The CFPB found that Block's Cash App relied on an automated macro-based dispute handling system that closed fraud claims without meaningful human review, denied provisional credits required by federal law, and automatically challenged at least 75% of chargebacks without assessing their validity. The consent order filed on January 16, 2025 requires Block to pay $120 million in consumer refunds and a $55 million civil penalty. The violations spanned from 2016 through 2023 and affected hundreds of thousands of Cash App users.
- Confidence
- High (multi-source, primary)
Bloomberg issued at least 36 corrections to AI-generated Terminal news summaries
Bloomberg launched AI-generated bullet-point summaries atop its Terminal and website articles on January 15, 2025, and subsequently had to issue at least 36 corrections for errors including wrong dates, inaccurate figures, and misattributed claims. Specific errors included incorrectly stating when Trump tariff actions would take place and falsely claiming the United Steelworkers opposed a mill owner's plans. Bloomberg stated that 99 percent of AI summaries met editorial standards and that journalists retained full control over whether summaries appeared.
- Confidence
- Medium (multi-source)
Klarna reversed its all-AI customer service stance after quality and retention dropped
After publicly celebrating that an OpenAI agent had replaced 700 customer service jobs, Klarna's CEO said in 2024 the company was rehiring humans because the AI-only experience hurt quality.
- Confidence
- Medium (multi-source)
Upstart rejected its fair-lending monitor's less-discriminatory model, ending the monitorship
An independent fair lending monitor (Relman Colfax) found statistically significant approval disparities for Black applicants in Upstart's AI lending model during a multi-year oversight process from December 2020 through March 2024. The monitor proposed a less discriminatory alternative (LDA) model to address these disparities, but Upstart rejected it on accuracy grounds and offered its own alternative, which the monitor declined to validate. The disagreement ended the monitorship in an impasse, leaving the approval disparities unremediated.
- Confidence
- High (multi-source, primary)
Worldcoin suspended in Spain after regulator orders halt to biometric data processing
Spain's Data Protection Agency (AEPD) issued a precautionary measure on 2024-03-06 preventing Worldcoin (Tools for Humanity) from processing personal data in Spain. The action followed complaints alleging insufficient information and concerns about the collection and processing of biometric iris scans. Subsequent reporting indicated Spanish authorities later ordered deletion of data collected in Spain.
- Confidence
- High (multi-source, primary)
TurboTax's Intuit Assist gave wrong tax advice on over half of test questions, the Post found
Washington Post tech columnist Geoffrey A. Fowler tested TurboTax's Intuit Assist AI chatbot with 16 tax questions and found it gave wrong or irrelevant answers on more than half. Specific failures included recommending incorrect filing statuses and fabricating irrelevant education credit advice when asked about air conditioner tax credits. Even after Intuit updated the software, the chatbot remained unhelpful on a quarter of the questions.
- Confidence
- Medium (multi-source)
Revolut's Sherlock fraud system autonomously froze thousands of accounts without adequate review
Revolut's machine learning fraud detection system, Sherlock, autonomously flagged and froze customer accounts based on suspicious transaction patterns, often without sufficient human review before action was taken. Thousands of customers reported being locked out of their accounts for extended periods with no emergency phone line and only an in-app chat function for resolution. Lithuania's central bank fined Revolut €3.5 million for AML compliance failures, citing over-reliance on automated systems at the expense of human oversight.
- Confidence
- High (multi-source, primary)
Binance CCO impersonated in deepfake exchange listing scam
Hackers used an AI-generated deepfake of Binance CCO Patrick Hillmann to deceive cryptocurrency project founders. The scammers impersonated Hillmann in video calls to facilitate fraudulent exchange listing agreements.
- Confidence
- High (multi-source, primary)
Hello Digit fined $2.7M for faulty automated savings algorithm
The CFPB penalized Hello Digit for deploying an automated savings tool that caused overdrafts, despite a no-overdraft guarantee. The agency ordered a civil penalty of $2.7 million and required redress to affected consumers; it also alleged that the company kept interest earned on consumer funds.
- Confidence
- High (multi-source, primary)
Upstart credit models challenged for disparate impact on minority borrowers
The CFPB revoked a regulatory exemption for Upstart in June 2022 after its AI credit models were challenged for disparate impact on minority borrowers. The controversy centered on the use of educational data in the automated underwriting system.
- Confidence
- High (multi-source, primary)
Equifax automated credit reporting systems fail to process consumer disputes
Equifax failed to properly investigate consumer credit disputes and inaccurately reported credit scores. The CFPB issued a $15 million penalty for these systemic failures in the company's automated reporting and scoring systems.
- Confidence
- High (multi-source, primary)
Goldman Sachs Apple Card underwriting model investigated for perceived gender bias
Goldman Sachs Bank USA's Apple Card underwriting faced a regulatory inquiry. The NYDFS found no evidence of disparate impact but criticized transparency and customer communication around the algorithmic decisions.
- Confidence
- High (multi-source, primary)
Apple Card algorithm allegedly grants lower credit limits to women
Goldman Sachs faced allegations that its Apple Card algorithm discriminated against women. A regulatory probe by the NY DFS followed, though the regulator eventually found no violation of fair lending laws.
- Confidence
- Medium (multi-source)
Betterment settles SEC charges over automated tax-loss harvesting errors
Betterment settled SEC charges regarding misstatements and failures in its automated tax-loss-harvesting service. The company paid $9 million in penalties and provided restitution to 25,000 affected clients.
- Confidence
- Medium (multi-source)