UK High Court warns lawyers against AI misuse after fake citations
The UK High Court warned lawyers to stop the misuse of AI after fake case-law citations appeared in court filings, with Dame Victoria Sharp flagging potential sanctions.
AI outputs can confidently assert fabricated authorities if not verified.
Key facts
- What
- The UK High Court warned lawyers to stop the misuse of AI after fake case-law citations appeared in court filings, with Dame Victoria Sharp flagging potential sanctions.
- Incident date
- Jun 6, 2025
- Who
- UK High Court (England and Wales)
- Failure mode
- Hallucination
- AI surface
- Chatbot
- Severity
- High
What happened
The UK High Court issued a regulatory warning after two cases contained fictitious citations generated by AI. In one case, 18 of 45 citations were fictitious, and in another, there were multiple fictitious citations. Dame Victoria Sharp warned that misusing AI could lead to sanctions, including contempt of court.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
The failure stemmed from AI-generated citations that appeared credible but were not real authorities. Verification by counsel or the court did not occur until the citations were challenged.
What it cost
Sources
Cite this entry
https://failureindex.ai/failures/high-warns-lawyers-misuse-fake-citationsAI Failure Index. "UK High Court warns lawyers against AI misuse after fake citations" (FI-0283). Realm Labs. https://failureindex.ai/failures/high-warns-lawyers-misuse-fake-citations (indexed Jun 5, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0283. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.