South Africa withdraws AI policy after AI-generated citations found
South Africa’s Department of Communications and Digital Technologies withdrew its Draft National Artificial Intelligence Policy after investigations found AI-generated citations in the draft; the Government Gazette published it for public comment on 10 April 2026, and withdrawal followed in late April 2026 amid political backlash.
AI-generated citations were included without proper verification, leading to fabricated sources in an official policy document.
Key facts
- What
- South Africa’s Department of Communications and Digital Technologies withdrew its Draft National Artificial Intelligence Policy after investigations found AI-generated citations in the draft; the Government Gazette published it for public comment on 10 April 2026, and withdrawal followed in late April 2026 amid political backlash.
- Incident date
- Apr 27, 2026
- Who
- Department of Communications and Digital Technologies (Republic of South Africa)
- Failure mode
- Hallucination
- AI surface
- Chatbot
- Severity
- Medium
What happened
The department published a Draft National Artificial Intelligence Policy in the Government Gazette for public comment on 10 April 2026. Investigative reporting showed several references in the draft were fictitious and some appeared AI-generated. Facing these revelations, the policy was withdrawn in late April 2026 with ministerial statements of accountability.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
The drafting process used AI-generated citations that were not properly validated, leading to fictitious journal titles and authors being included in the official policy document. Verification and QA processes failed to catch the falsified sources before publication.
What it cost
Sources
- PressSouth Africa pulls AI policy after hallucinated citations expose drafting scandalcnbcafrica.com
- PressSouth Africa withdraws AI policy due to fake AI-generated sourcesreuters.com
- PrimarySTATEMENT ON MINISTER MALATSI’S USE OF ARTIFICIAL INTELLIGENCE IN DRAFTING SOUTH AFRICA’S NATIONAL AI POLICYancparliament.org.za
Cite this entry
https://failureindex.ai/failures/south-africa-withdraws-policy-generated-citationsAI Failure Index. "South Africa withdraws AI policy after AI-generated citations found" (FI-0201). Realm Labs. https://failureindex.ai/failures/south-africa-withdraws-policy-generated-citations (indexed Jun 5, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0201. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.