South African Government withdraws draft AI policy containing AI hallucinations
South Africa's draft national AI policy was withdrawn after it was found to contain fabricated academic citations. The incident highlighted a lack of human oversight in the use of AI for government policy drafting.
The hallucination did not just invent sources; it manufactured seemingly credible African scholarly authority.
Key facts
- What
- South Africa's draft national AI policy was withdrawn after it was found to contain fabricated academic citations.
- Incident date
- Apr 10, 2026
- Who
- South African Government
- Failure mode
- Hallucination
- AI surface
- Copilot
- Severity
- Medium
What happened
The South African government published a draft of its first national AI policy. The document was later found to contain fictitious references, including fabricated academic citations and authors. The government withdrew the draft after the hallucinations were exposed.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
An AI model used for drafting the policy generated fake scholarly citations to support its claims. The human oversight process failed to verify these references before the document was made public.
What it cost
Sources
- PressSouth Africa Pulls Ai Policy After Hallucinated Citations Expose Drafting Scandalcnbcafrica.com
- PressSouth Africa withdraws AI policy filled with AI hallucinationsmashable.com
- PrimaryLessons from SA's AI policy based on fake researchwits.ac.za
Cite this entry
https://failureindex.ai/failures/south-african-government-withdraws-draft-policyAI Failure Index. "South African Government withdraws draft AI policy containing AI hallucinations" (FI-0551). Realm Labs. https://failureindex.ai/failures/south-african-government-withdraws-draft-policy (indexed Jun 16, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0551. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.