FLP logo

How to Check AI’s Legal Work Against Real Court Records

Nadia Hicks

AI is increasingly part of everyday legal work, helping people research faster and draft more efficiently. Like any research tool, it can get things wrong, with mistakes ranging from fake cases to arguments that quietly hurt the client. Many of those mistakes can be caught by checking AI’s work against real court records, and Free Law Project builds free tools that help anyone do it.

Close-up of three worn leather-bound volumes of the American Digest, Century Edition, covering 1658 to 1896, shown in sepia tones. The spines read Vol. 13, Costs to Courtyard; Vol. 14, Covenant, Action of, to Criminal Law; and Vol. 15, Criminal Law to Dedimus Potestatem.
Volumes of the American Digest at the Great Library, Osgoode Hall, Toronto. Photo by Alan Shin, 2006, CC BY 2.0, cropped.

AI’s legal mistakes range from fake cases to bad arguments

Using AI is increasingly the norm in legal work. Most legal professionals use general-purpose AI tools on the job, according to 8am’s 2026 Legal Industry Report. Law students are more divided. Many worry about relying on AI, and some law schools, including Berkeley Law, now bar it for most coursework. Still, in a Law360 Pulse survey this summer, 96% of summer associates said they used AI at work, up from 80% a year earlier. People representing themselves are reaching for the same tools, often because getting a lawyer isn’t an option.

The best-known mistake is the fake citation. In 2023, U.S. District Judge P. Kevin Castel in Manhattan sanctioned two lawyers for filing a brief full of court cases that ChatGPT made up, writing in Mata v. Avianca that “a fake opinion is not ‘existing law.’” Since then, courts worldwide have issued more than 2,000 decisions involving AI-fabricated material, according to a public database kept by Damien Charlotin, a researcher at HEC Paris. Most involve people representing themselves, but more than 800 involve licensed lawyers. Appeals courts have started quoting Judge Castel’s line back to lawyers, and the Fifth Circuit cited Charlotin’s database by name.

Other mistakes are harder to see. New research testing AI-written briefs found that even the strongest models sometimes concede points their client didn’t need to give up, drop strong arguments from earlier filings, or rely on court decisions that have been set aside. These errors can look like ordinary legal writing, and the cases they cite are real. AI can also cite a real case for a point it doesn’t make.

Here’s what can catch each kind of mistake:

MistakeExampleWhat catches it
Fake citationA case that doesn’t existCitation Lookup, free on CourtListener
Misstated caseA real case that doesn’t support the point it’s cited forA careful read of the cited case
Bad lawA real case that’s been overturned or set asideA commercial citator (or ours once it’s ready)
Weak argumentA concession or dropped argument that hurts the clientA lawyer who knows the client and the case

Free tools anyone can use to check AI’s work

Citation Lookup

Citation Lookup on CourtListener takes you to the case a citation points to, so you can see whether it exists. It checks one citation at a time: paste in a longer passage, and it looks up the first citation it finds. To check every citation in a brief at once, developers can use our Citation Lookup and Verification API, launched in 2024. It matches citations against more than 18 million in CourtListener and flags the ones it can’t find.

CourtListener in your AI assistant

If you already use an AI assistant for legal research, you can connect it to CourtListener through our MCP connector, so it looks up real cases instead of guessing. It works with several popular AI assistants.

An AI citator

A real case isn’t always good law. Commercial citators have tracked this for decades, but they come with paid research subscriptions. We’re building a free, open-source citator to flag cases that have been overturned or weakened, and testing it against a benchmark of good and bad law built with more than 80 volunteer legal experts.

Testing AI in the open requires public court records

Tools catch mistakes one brief at a time. To know whether AI is getting better overall, you need benchmarks: standard tests that run the same way on every model, so results can be compared over time. In law, a good benchmark has to look past whether a brief seems polished and judge whether its arguments hold up.

That takes real cases, in records anyone can check. The research cited above, from Harvey, built its test from case law in CourtListener and federal cases in RECAP, our archive of court records. In part of the test, AI models searched for case law through our CourtListener MCP connector.

Tests like this one mostly cover federal courts, because federal dockets and filings are collected in one place: PACER. But the vast majority of cases are filed in state courts. We’re working to close that gap. CourtListener already has opinions from state courts and the U.S. Supreme Court, and will soon add dockets and filings from courts in five states.

AI should support the legal field, not undermine it

Used well, AI can help people understand their legal problems and help lawyers research faster. Used carelessly, it wastes courts’ time, misleads people without legal training, and erodes trust in what gets filed. Free Law Project’s role is to provide the foundational data, tools, and tests that legal AI should be built on and measured against, so it is a force for good. That means people without legal training aren’t fed false legal information, lawyers’ AI assistants rely on real court data, and benchmarks reflect how complex legal work really is.

Even good tools have limits. Citation Lookup checks that a case exists and shows you where to read it. It doesn’t check whether the case supports the point it’s cited for. That part still takes a careful read.

The better AI gets at legal writing, the more it matters that its work can be checked against the real record.

© 2026 Free Law Project. Content licensed under a Creative Commons BY-ND international 4.0, license, except where indicated. Site powered by Netlify.