Deloitte Australia refunds government after AI-produced report with hallucinations

Deloitte Australia refunded the government after an AI drafted report contained hallucinations, with outlets reporting the $290,000 refund and the AI-related errors.

Deloitte Australia · Incident Oct 6, 2025 · Indexed Jun 5, 2026 · 3 sources

AI-generated content in a government report led to hallucinations that Deloitte had to address with a refund.
What
Deloitte Australia refunded the government after an AI drafted report contained hallucinations, with outlets reporting the $290,000 refund and the AI-related errors.
Incident date
Oct 6, 2025
Who
Deloitte Australia
Failure mode
Hallucination
AI surface
Copilot
Severity
Medium

What happened

Deloitte Australia used GPT-4o via Azure OpenAI to draft a report for the Australian federal government. The draft contained hallucinations, including fabricated references and invented quotes. Deloitte acknowledged the errors and agreed to refund the government A$290,000. Media outlets reported the incident in October 2025, highlighting AI risks in professional services without rigorous human verification of citations.

What broke inside the model

Failure path · mode profile · Hallucination
  1. 01 · TriggerA user asks for a fact, a citation, or a figure.
  2. 02 · Model stepThe model writes a fluent, confident answer.
  3. 03 · Control gapNothing ties the claim back to a real source.
  4. 04 · FailureA fabricated fact ships as if it were verified.
  5. 05 · ConsequenceThe false claim reaches a customer, a court, or the public.

Confidence holds, and even spikes, as the claim detaches from any source.

The report was drafted with generative AI (GPT-4o via Azure OpenAI). Several citations within the draft were fabricated, and quotes were invented, indicating a breakdown in fact-checking and human verification of AI-generated content.

Public visibilityMedium
Regulatory exposurePossible
Customer impactFew customers
Financial impactDisclosed
Time to disclosureDays
  1. PressDeloitte to pay money back to Albanese government after using AI in $440,000 reporttheguardian.com
  2. PressDeloitte Australia will partially refund the Australian government for a report filled with apparent AI-generated errorsapnews.com
  3. PressDeloitte's member firm in Australia will pay the government a partial refund for a $290,000 report that contained alleged AI-generated errorsfortune.com
Permalinkhttps://failureindex.ai/failures/deloitte-australia-refunds-government-produced-hallucin
CitationAI Failure Index. "Deloitte Australia refunds government after AI-produced report with hallucinations" (FI-0197). Realm Labs. https://failureindex.ai/failures/deloitte-australia-refunds-government-produced-hallucin (indexed Jun 5, 2026).
Share cardA branded image of this record for posts and slides.

Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0197. Full dataset at /data.

Note from Realm Labs, the Index steward

How Realm would have caught this

Controls for this failure mode
  • Prism
  • OmniGuard
  • AI Detection & Response (AIDR)

A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.