City of Aberdeen legal team sanctioned for First Drafts AI hallucinations
Lawyers in the case Withers v. City of Aberdeen used AI to file documents containing fabricated case law. The court imposed an $8,000 fine and disqualified several attorneys after discovering the hallucinations.
The tool generated six fabricated cases and a false quote that the lawyer filed without verification.
Key facts
- What
- Lawyers in the case Withers v.
- Incident date
- Jun 8, 2026
- Who
- City of Aberdeen
- Failure mode
- Hallucination
- AI surface
- Copilot
- Severity
- High
What happened
A lawyer representing a party in the case Withers v. City of Aberdeen used the AI tool First Drafts to prepare court filings. The resulting documents contained six fabricated case citations and one false quote. The U.S. District Court for the Northern District of Mississippi revoked pro hac vice status, disqualified resident attorneys, and imposed an $8,000 fine.
What broke inside the model
- 01 · TriggerA user asks for a fact, a citation, or a figure.
- 02 · Model stepThe model writes a fluent, confident answer.
- 03 · Control gapNothing ties the claim back to a real source.
- 04 · FailureA fabricated fact ships as if it were verified.
- 05 · ConsequenceThe false claim reaches a customer, a court, or the public.
Confidence holds, and even spikes, as the claim detaches from any source.
The First Drafts AI tool generated hallucinations, creating fictitious legal citations and quotes that appeared authentic. The system failed to verify the existence of the cited cases against a real legal database.
What it cost
Sources
- PrimaryHallucinations Case Databasedamiencharlotin.com
- PressJudge Punishes 4 Lawyers After Catching Both Sides Using A.I. in Lawsuitnytimes.com
- PressLawyers Sanctioned Over AI Use on Both Sides in Federal Casenews.bloomberglaw.com
Cite this entry
https://failureindex.ai/failures/city-aberdeen-legal-team-sanctioned-firstAI Failure Index. "City of Aberdeen legal team sanctioned for First Drafts AI hallucinations" (FI-0580). Realm Labs. https://failureindex.ai/failures/city-aberdeen-legal-team-sanctioned-first (indexed Jun 16, 2026).Data fields CC-BY 4.0, prose citation permitted. Incident ID FI-0580. Full dataset at /data.
Note from Realm Labs, the Index steward
How Realm would have caught this
- Prism
- OmniGuard
- AI Detection & Response (AIDR)
A runtime layer that watches the model's internal state can flag the moment a model commits to a claim it has no support for, and hold or reroute the response before it reaches a user. Realm reads those signals in real time rather than grading the transcript after the fact.