LegalCiteBench - Case Matching: leaderboard
LegalCiteBench (2026) tests whether LLMs, without retrieval, can recover and verify the case authorities cited in 1,000 U.S. judicial opinions from the Case Law Access Project. In case matching the model identifies the source case of an anonymized legal scenario; judge score from 0 to 100, higher is better.
Metric: Cat4-1 judge score (0-100) for matching an anonymized legal scenario to its source case name and citation (1,997 instances), closed-book (no retrieval) on instances derived from 1,000 U.S. judicial opinions of the Case Law Access Project, greedy decoding at temperature 0 with at most 400 generated tokens, GPT-4o-mini judge; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 21 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 Mini | 74 | #364 |
| 2 | DeepSeek-R1-Distill-Qwen-7B | 55.53 | #8055 |
| 3 | DeepSeek R1 Distill Qwen 1.5B | 53.42 | #9215 |
| 4 | Qwen 3 14B | 43.26 | #1269 |
| 5 | Qwen 2.5 7B | 43.24 | #2929 |
| 6 | O4 Mini | 42.39 | #368 |
| 7 | DeepSeek V3.1 | 42.29 | #511 |
| 8 | Claude Sonnet 4.5 | 41.64 | #261 |
| 9 | Gemini 2.5 Flash | 41.12 | #463 |
| 10 | Claude Haiku 4.5 | 40.56 | #583 |
| 11 | Phi-4 | 40.32 | #1931 |
| 12 | Llama 3.1 8B | 40.24 | #5196 |
| 13 | Qwen 3 4B | 40.05 | #2348 |
| 14 | GPT-4o Mini | 39.54 | #1667 |
| 15 | Qwen 3 30B A3B | 39.32 | #1156 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=legalcitebench-case-matching · How It Works · Data refreshed daily, snapshot 2026-11-21.