CaseLaw v2: leaderboard

Private question-answer benchmark over Canadian court-cases.

Metric: Accuracy (%). Source: vals.ai. Source: benchmarklist.com. 54 models tracked.

Top models

#ModelScoreOverall rank
1Grok 4.379.31#188
2GPT-5.1 (2025-11-13) (High)73.42#101 (GPT-5.1 (2025-11-13))
3GPT-4.169.88#248
4GPT-5 Mini (2025-08-07) (High)68.49#172 (GPT-5 Mini (2025-08-07))
5Claude Opus 4.768.38#49
6GPT-566.45#98
7GPT-5 (2025-08-07) (High)66.45
8GPT-5.5 (xHigh)66.24#31 (GPT-5.5)
9GPT-5.266.02#110
10GPT-5.2 (2025-12-11) (xHigh)66.02
11Grok 465.81#181
12Kimi K2 (Thinking)65.7#243 (Kimi K2)
13Grok 4 Fast (Reasoning)65.7#254 (Grok 4 Fast)
14Gemini 3.1 Pro (Preview) (High)64.84#58 (Gemini 3.1 Pro (Preview))
15Command A64.52#508

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=caselaw-v2 · How It Works · Data refreshed daily, snapshot 2026-10-20.