TL;DR

Legal experts are calling for UK judges to stop quoting AI-generated fake case citations in full when ruling on their misuse. The concern is that reproducing hallucinated cases in official judgments risks inadvertently embedding bogus authorities as precedents, creating self-propagating legal misinformation.

The Paradox of Transparency

Lawyers and commentators are warning that well-intentioned judicial transparency may be backfiring. When judges cite fabricated cases in full to demonstrate the problem of AI hallucinations, they risk those very fabrications being absorbed into the legal corpus that AI systems subsequently train on.

Matthew Lee, a barrister at Doughty Street Chambers and founder of the Natural and Artificial Intelligence in Law blog, highlighted the tension: “Well-intentioned judges often cite hallucinated cases and their erroneous legal principles in full within official judgments to show the extent of the problem to those reading. However, judges may be inadvertently exacerbating the issue because those AI-generated inaccuracies are being integrated into the established legal canon indirectly.”

Growing Calls for Action

Jim Sturman KC from 2 Bedford Row echoed these concerns on LinkedIn: “The time has come for English judges to stop reciting the names of bogus cases in judgments. Doing so risks embedding bogus ‘authorities’ in the corpus of law reports. It would be safer, and easy, to write ‘fake case 1’ etc.”

The issue follows an increasing number of cases where litigants and lawyers have presented AI-generated case law that turned out to be entirely fabricated.

International Precedent

While UK courts have yet to address this specific issue, Australia has moved ahead. In JML Rose Pty Ltd v Jorgensen, Mrs Justice Wheatley adopted a policy of redacting false case citations “so that such information is not further propagated by AI systems.”

Looking Forward

For UK businesses using AI for research or document preparation, this case reinforces the critical importance of verification. Legal documents, contracts and formal submissions that cite external sources require human review against authoritative databases. The self-reinforcing nature of AI training on its own outputs means today’s unchecked hallucination could become tomorrow’s confidently-stated falsehood.