XpertBench - Law: leaderboard
The law tasks of XpertBench (2026), open-ended professional assignments written by domain experts and graded against typically 15 to 40 weighted expert rubric checkpoints per task. Weighted rubric score in percent on the law part of the XpertBench-Gold subset, judged by Gemini 2.5 Pro; higher is better.
Metric: Weighted rubric score (%) on the XpertBench-Gold subset (245 expert-written open-ended professional tasks, 15-40 weighted binary checkpoints each); ShotJudge: Gemini 2.5 Pro judges every checkpoint with an expert-graded GPT-5 response as one-shot exemplar; law tasks; higher is better. Source: arxiv.org. Saturation forecast: Around August 2027. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Opus 4.6 | Thinking | 65.54 | #113 |
| 2 | Doubao-2.0-pro | 65.06 | #149 | |
| 3 | GPT-5.4 | High | 64.79 | #135 |
| 4 | Claude Sonnet 4.5 | Thinking | 58.7 | #261 |
| 5 | Kimi K2 (Thinking) | 58 | ||
| 6 | GPT-5.2 | High | 56.88 | #185 |
| 7 | GPT-5 | High | 54.7 | #178 |
| 8 | Gemini 3.1 Pro (Preview) | 53.88 | #99 | |
| 9 | DeepSeek V3.1 Terminus | Thinking | 51.9 | #437 |
| 10 | Gemini 3 Flash | 50.22 | #175 | |
| 11 | Doubao-Seed-1.6 | Thinking | 49.4 | |
| 12 | Gemini 3 Pro | 48.59 | #145 | |
| 13 | Gemini 2.5 Pro | 47.3 | #276 | |
| 14 | GLM-4.6 | 47.2 | #498 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=xpertbench-law · How It Works · Data refreshed daily, snapshot 2026-11-21.