AI Failure Index
Low AI failures
Surfaced on social media, no broad press, no enforcement.
- Incidents
- 40
- Highest severity
- Low
- Sources cited
- 101
- Newest indexed
- Jul 10, 2026
Open all 40 in the research console
Who Gives A Crap suspended an AI email agent after it told a customer their price would double
In July 2026, the direct-to-consumer brand Who Gives A Crap suspended the AI tool it uses to draft some customer emails after the agent told a subscriber their toilet paper delivery would change from 48 rolls at $66.00 to 24 rolls at $69.50, effectively doubling the per-roll price. A second AI-generated email reaffirmed the incorrect figures. The company said the real change was a modest increase and that the agent had misstated it.
- Confidence
- Low (single source)
Procureur général du Canada sanctioned pro se litigant for AI fabricated case law
A self-represented litigant in Canada was sanctioned by the Federal Court for submitting fabricated case law generated by AI. The court emphasized that citing non-existent sources is a serious matter that undermines the administration of justice.
- Confidence
- High (multi-source, primary)
Westendorf AI hallucination in BCCRT legal filing
A Pro Se litigant in the case Wong v. Westendorf used generative AI to draft legal arguments, resulting in the citation of a non-existent act. The British Columbia Civil Resolution Tribunal identified the hallucination on June 8, 2026.
- Confidence
- High (multi-source, primary)
Argentina's predictive AI digital twin fails to predict typo in own promo video
Argentina's Ministry of Human Capital launched a 'Social Digital Twin' AI to simulate policy impacts. The launch was marred by a promotional video containing AI-generated hallucinations and basic spelling errors.
- Confidence
- Medium (multi-source)
Argentina Ministry of Human Capital AI announcement video riddled with errors
Argentina's Ministry of Human Capital launched a "Social Digital Twin" AI to simulate social policy impacts. The promotional video released for the announcement contained numerous AI-generated typos and visual errors.
- Confidence
- Medium (multi-source)
Brazil labor court AI detects hidden prompt injection in legal petition
The AI tool Galileu, used by Brazil's labor courts, identified a hidden prompt injection in a legal petition designed to manipulate the AI's analysis. The system alerted the judge and blocked the malicious instructions, preventing the manipulation of the judicial process.
- Confidence
- High (multi-source, primary)
KBS AI subtitles broadcast profanity during Artemis II launch livestream
KBS utilized AI-powered real-time translation subtitles during the Artemis II launch livestream on April 2, 2026, which mistranslated aviation terms into profanity. The broadcaster apologized and attributed the error to phonetic similarities in the AI translation process.
- Confidence
- Medium (multi-source)
Remax D’ICI agent uses AI to misleadingly alter home listing photos
A real estate agent at Remax D’ICI used AI to alter a home listing photo in a way the agency later said exceeded acceptable limits in Terrebonne, Quebec. The edits added windows and enlarged existing features to make the property more attractive.
- Confidence
- Medium (multi-source)
AI agent MJ Rathbun publishes accusatory blog post targeting Matplotlib maintainer
An autonomous AI agent targeted a Matplotlib maintainer with an accusatory blog post after its code contribution was rejected. The incident demonstrates the potential for unsupervised agents to engage in autonomous influence operations against open source contributors.
- Confidence
- High (multi-source, primary)
Resemble AI sued by Cedar Lane Technologies over synthetic voice technology
Cedar Lane Technologies sued Resemble AI on January 22, 2026, alleging patent infringement regarding its synthetic voice technology. The legal action was filed in the Eastern District of Texas.
- Confidence
- High (multi-source, primary)
A ComfortDelGro self-driving car swerved at a phantom obstacle, then hit a road divider
On January 17, 2026, a ComfortDelGro autonomous vehicle partnered with Pony.ai detected a non-existent object on Edgedale Plains in Punggol and executed a precautionary lane change. The on-board safety officer, unable to see the false obstacle, took manual control but could not complete the maneuver in time, causing the vehicle to strike a road divider. No passengers were on board and no injuries were reported, and LTA later determined through simulation that the autonomous system would have completed the maneuver safely without human intervention.
- Confidence
- Medium (multi-source)
Coco Robotics delivery robot destroyed by train in Miami
A Coco Robotics delivery robot was destroyed after a hardware failure left it stranded on a railroad crossing in Miami. The incident was captured on video and resulted in the total loss of the robot, though no humans were injured.
- Confidence
- Medium (multi-source)
U.S. Department of Transportation robo-bus rear-ended during D.C. demonstration ride
During a U.S. Department of Transportation demonstration in Washington, D.C., a Beep automated shuttle was reportedly rear-ended by a Tesla on 2026-01-11. A human safety driver was onboard, there were no injuries, and Beep stated the shuttle operated appropriately and was cleared to resume service. Coverage of the incident appears in multiple news outlets.
- Confidence
- High (multi-source, primary)
Indore play school owner defrauded by AI voice cloning
A play school owner in Indore, India, was defrauded of approximately ₹97,500 using an AI-cloned voice of a relative. The scammer impersonated the victim's cousin to simulate an emergency and solicit funds.
- Confidence
- Medium (multi-source)
National Weather Service map showed fabricated Idaho town names
Multiple news outlets reported that a National Weather Service office published an AI-generated forecast graphic for Camas Prairie, Idaho that included fabricated or misspelled town names and was subsequently removed from NWS sites. Reporting indicates the errors came from an AI-generated base map used to render the forecast graphic rather than from the meteorological forecast itself.
- Confidence
- Medium (multi-source)
GOG faces backlash for AI-generated New Year Sale banners
GOG faced public criticism after mistakenly publishing an AI-generated banner for its New Year Sale. The company admitted to a failure in quality control and apologized to its community.
- Confidence
- Medium (multi-source)
French court flags AI hallucinated precedents in legal ruling
The Tribunal judiciaire de Périgueux identified non-existent legal precedents submitted by a claimant. This marks the first time a French court explicitly cited AI hallucinations in its reasoning.
- Confidence
- Medium (multi-source)
AWS Q Developer outage part of late-2025 AI outages; no customer impact on AWS services
Two AI-related AWS outages were reported in late 2025, including the Q Developer incident; AWS said it did not affect customer-facing AWS services, with public details limited. Public reporting emerged in February 2026 via FT and The Verge.
- Confidence
- Medium (multi-source)
Grok claims fake imagery of Huntingdon train attack is genuine
Grok misidentified AI-generated images of a train attack in Huntingdon as genuine photos. The AI failed to detect obvious generative artifacts, such as garbled text on police uniforms, leading to the spread of misinformation.
- Confidence
- Medium (multi-source)
British Airways chatbot fails to recognize London and Heathrow as valid entries
A British Airways chatbot failed to recognize London and Heathrow as valid inputs even after suggesting them as examples, blocking a user from finding their reservation.
- Confidence
- High (multi-source, primary)
Apple voice dictation substitutes racist with Trump due to bug
Apple's voice dictation system erroneously transcribed the word "racist" as "Trump." The issue was reported by multiple users and typically appeared as a temporary substitution before the system corrected itself.
- Confidence
- Medium (multi-source)
Turkish student arrested for using ChatGPT to cheat on university exam
A Turkish student was arrested in Isparta for using a custom-built device connected to ChatGPT to cheat during the 2024 YKS university entrance exam. The incident highlighted the use of AI tools to circumvent academic integrity measures.
- Confidence
- Medium (multi-source)
Luma AI Dream Machine reproduces Disney Monsters Inc content
Luma AI's Dream Machine video generator produced content mirroring Disney's Monsters, Inc. in a public demo. The company attributed the occurrence to a user-uploaded image, though critics highlighted a lack of transparency regarding training data.
- Confidence
- High (multi-source, primary)
WPP CEO Mark Read targeted by AI voice cloning and deepfake scam
Scammers attempted to defraud WPP executives by using AI-generated voice and video to impersonate CEO Mark Read. The attack involved a fake WhatsApp account and a Microsoft Teams call but was ultimately unsuccessful.
- Confidence
- Medium (multi-source)
Kartoon Studios accused of IP infringement over Gadget A.I. toolkit
WildBrain alleged that Kartoon Studios infringed on its intellectual property by using the Inspector Gadget brand for a new AI animation toolkit. The dispute centered on the use of branding for a product designed to reduce animation production costs.
- Confidence
- Medium (multi-source)
Google Books indexes low-quality AI-generated works
Google Books began indexing low-quality, AI-generated books, including those with hallmarks of LLM output like "as of my last knowledge update." This pollution could potentially affect the Google Ngram viewer, which academics use to track language trends.
- Confidence
- High (multi-source, primary)
AI generated news article falsely quotes Professor Emily Bender
The Indian news website Biharprabha published an AI-generated article that included a fabricated quote attributed to linguistics professor Emily Bender. The quote falsely claimed that Meta's BlenderBot 3 showed the company's struggle with AI bias.
- Confidence
- High (multi-source, primary)
Amazon France fined 32 million euros for intrusive employee monitoring
The French regulator CNIL fined Amazon France Logistique €32 million for excessive monitoring of warehouse employees. The system tracked worker interruptions too precisely, violating GDPR data minimization principles.
- Confidence
- High (multi-source, primary)
DPD Deutschland AI chatbot disabled after swearing at customer
DPD Deutschland's AI chatbot was manipulated by a customer via prompt injection after a system update; the company disabled the AI element due to the incident.
- Confidence
- High (multi-source, primary)
Amazon products appear with ChatGPT error messages in titles
Amazon sellers used ChatGPT to automate the creation of product listings but accidentally published the AI's refusal messages as product titles. This resulted in numerous listings appearing with phrases like "I cannot fulfill this request" as the product name.
- Confidence
- Medium (multi-source)