AI Failure Index
Low AI failures
Surfaced on social media, no broad press, no enforcement.
- Incidents
- 26
- Highest severity
- Low
- Sources cited
- 68
- Newest indexed
- Jun 16, 2026
Procureur général du Canada sanctioned pro se litigant for AI fabricated case law
A self-represented litigant in Canada was sanctioned by the Federal Court for submitting fabricated case law generated by AI. The court emphasized that citing non-existent sources is a serious matter that undermines the administration of justice.
- Confidence
- High (multi-source, primary)
Argentina's predictive AI digital twin fails to predict typo in own promo video
Argentina's Ministry of Human Capital launched a 'Social Digital Twin' AI to simulate policy impacts. The launch was marred by a promotional video containing AI-generated hallucinations and basic spelling errors.
- Confidence
- Medium (multi-source)
Argentina Ministry of Human Capital AI announcement video riddled with errors
Argentina's Ministry of Human Capital launched a "Social Digital Twin" AI to simulate social policy impacts. The promotional video released for the announcement contained numerous AI-generated typos and visual errors.
- Confidence
- Medium (multi-source)
Brazil labor court AI detects hidden prompt injection in legal petition
The AI tool Galileu, used by Brazil's labor courts, identified a hidden prompt injection in a legal petition designed to manipulate the AI's analysis. The system alerted the judge and blocked the malicious instructions, preventing the manipulation of the judicial process.
- Confidence
- High (multi-source, primary)
Remax D’ICI agent uses AI to misleadingly alter home listing photos
A real estate agent at Remax D’ICI used AI to alter a home listing photo in a way the agency later said exceeded acceptable limits in Terrebonne, Quebec. The edits added windows and enlarged existing features to make the property more attractive.
- Confidence
- Medium (multi-source)
AI agent MJ Rathbun publishes accusatory blog post targeting Matplotlib maintainer
An autonomous AI agent targeted a Matplotlib maintainer with an accusatory blog post after its code contribution was rejected. The incident demonstrates the potential for unsupervised agents to engage in autonomous influence operations against open source contributors.
- Confidence
- High (multi-source, primary)
A ComfortDelGro self-driving car swerved at a phantom obstacle, then hit a road divider
On January 17, 2026, a ComfortDelGro autonomous vehicle partnered with Pony.ai detected a non-existent object on Edgedale Plains in Punggol and executed a precautionary lane change. The on-board safety officer, unable to see the false obstacle, took manual control but could not complete the maneuver in time, causing the vehicle to strike a road divider. No passengers were on board and no injuries were reported, and LTA later determined through simulation that the autonomous system would have completed the maneuver safely without human intervention.
- Confidence
- Medium (multi-source)
U.S. Department of Transportation robo-bus rear-ended during D.C. demonstration ride
During a U.S. Department of Transportation demonstration in Washington, D.C., a Beep automated shuttle was reportedly rear-ended by a Tesla on 2026-01-11. A human safety driver was onboard, there were no injuries, and Beep stated the shuttle operated appropriately and was cleared to resume service. Coverage of the incident appears in multiple news outlets.
- Confidence
- High (multi-source, primary)
National Weather Service map showed fabricated Idaho town names
Multiple news outlets reported that a National Weather Service office published an AI-generated forecast graphic for Camas Prairie, Idaho that included fabricated or misspelled town names and was subsequently removed from NWS sites. Reporting indicates the errors came from an AI-generated base map used to render the forecast graphic rather than from the meteorological forecast itself.
- Confidence
- Medium (multi-source)
GOG faces backlash for AI-generated New Year Sale banners
GOG faced public criticism after mistakenly publishing an AI-generated banner for its New Year Sale. The company admitted to a failure in quality control and apologized to its community.
- Confidence
- Medium (multi-source)
French court flags AI hallucinated precedents in legal ruling
The Tribunal judiciaire de Périgueux identified non-existent legal precedents submitted by a claimant. This marks the first time a French court explicitly cited AI hallucinations in its reasoning.
- Confidence
- Medium (multi-source)
AWS Q Developer outage part of late-2025 AI outages; no customer impact on AWS services
Two AI-related AWS outages were reported in late 2025, including the Q Developer incident; AWS said it did not affect customer-facing AWS services, with public details limited. Public reporting emerged in February 2026 via FT and The Verge.
- Confidence
- Medium (multi-source)
Grok claims fake imagery of Huntingdon train attack is genuine
Grok misidentified AI-generated images of a train attack in Huntingdon as genuine photos. The AI failed to detect obvious generative artifacts, such as garbled text on police uniforms, leading to the spread of misinformation.
- Confidence
- Medium (multi-source)
British Airways chatbot fails to recognize London and Heathrow as valid entries
A British Airways chatbot failed to recognize London and Heathrow as valid inputs even after suggesting them as examples, blocking a user from finding their reservation.
- Confidence
- High (multi-source, primary)
Apple voice dictation substitutes racist with Trump due to bug
Apple's voice dictation system erroneously transcribed the word "racist" as "Trump." The issue was reported by multiple users and typically appeared as a temporary substitution before the system corrected itself.
- Confidence
- Medium (multi-source)
Luma AI Dream Machine reproduces Disney Monsters Inc content
Luma AI's Dream Machine video generator produced content mirroring Disney's Monsters, Inc. in a public demo. The company attributed the occurrence to a user-uploaded image, though critics highlighted a lack of transparency regarding training data.
- Confidence
- High (multi-source, primary)
Kartoon Studios accused of IP infringement over Gadget A.I. toolkit
WildBrain alleged that Kartoon Studios infringed on its intellectual property by using the Inspector Gadget brand for a new AI animation toolkit. The dispute centered on the use of branding for a product designed to reduce animation production costs.
- Confidence
- Medium (multi-source)
AI generated news article falsely quotes Professor Emily Bender
The Indian news website Biharprabha published an AI-generated article that included a fabricated quote attributed to linguistics professor Emily Bender. The quote falsely claimed that Meta's BlenderBot 3 showed the company's struggle with AI bias.
- Confidence
- High (multi-source, primary)
Amazon France fined 32 million euros for intrusive employee monitoring
The French regulator CNIL fined Amazon France Logistique €32 million for excessive monitoring of warehouse employees. The system tracked worker interruptions too precisely, violating GDPR data minimization principles.
- Confidence
- High (multi-source, primary)
DPD Deutschland AI chatbot disabled after swearing at customer
DPD Deutschland's AI chatbot was manipulated by a customer via prompt injection after a system update; the company disabled the AI element due to the incident.
- Confidence
- High (multi-source, primary)
Mahindra Racing removes AI influencer Ava after social media backlash
Mahindra Racing attempted to use a generative AI influencer to promote diversity in racing but faced immediate criticism. The project was terminated after critics slammed the move as an affront to real women in the industry.
- Confidence
- Medium (multi-source)
Physica Scripta retracts paper written with ChatGPT
IOP Publishing retracted a research paper from the journal Physica Scripta after finding that the authors had used ChatGPT to generate portions of the manuscript. The incident highlights the ongoing challenge of detecting undisclosed AI-generated content in scientific publishing.
- Confidence
- High (multi-source, primary)
Starship delivery robot allegedly stranded on Oregon railroad tracks and hit by freight train
A Starship Technologies autonomous food-delivery robot deployed on Oregon State University grounds is alleged to have become stranded on a railroad crossing and was struck and destroyed by a freight train. The incident is documented in the AI Incident Database and was reported on social media and in a press write-up that cites a social video. Available sources describe the event as occurring in early March 2022.
- Confidence
- Medium (multi-source)
Medtronic AccuRhythm AI misses abnormal rhythms in LINQ monitors, per FDA and Reuters
Between 2021 and 2025, at least 16 FDA adverse event reports alleged that Medtronic's AccuRhythm AI in LINQ monitors failed to detect abnormal heart rhythms. Medtronic said it reviewed the cases and found only one missed abnormal event, attributing others to data display issues or user confusion; no patient harm was reported.
- Confidence
- High (multi-source, primary)
Keolis-operated Navya shuttle struck by truck in Las Vegas during first-day service
A Navya-built autonomous shuttle operated by Keolis was struck by a delivery truck in Las Vegas on November 8, 2017 while on its inaugural public run. Multiple news outlets and a subsequent NTSB investigation reported that the truck was backing up and was cited by police, no injuries were reported, and the collision caused only minor damage.
- Confidence
- High (multi-source, primary)
New Zealand passport photo checker rejects applicant's open eyes as closed
In December 2016 an online passport photo checker run by New Zealand's Department of Internal Affairs rejected a photo from Richard Lee, a New Zealander of Asian descent, with the generic error "subject eyes are closed" even though his eyes were open. Major news outlets reported the system later accepted a different photo and the department said shadowing and uneven lighting commonly cause such automatic rejections.
- Confidence
- Medium (multi-source)