LexRubric: leaderboard
LexRubric (2026) scores open-ended answers to 649 Chinese legal questions from everyday legal consultation and judicial examination against expert-written atomic rubric items, each checked by an LLM judge. This board is the overall score rate over all 649 instances. The score rate is earned rubric points (negative items subtract) over the maximum positive score in percent, averaged over instances; higher is better.
Metric: Overall score rate (%): points earned from expert-written atomic rubric items (weighted -10 to +10; negative items subtract) divided by the maximum positive score, averaged over all 649 instances (473 legal consultation, 176 judicial examination); a Qwen3.6-27B judge checks each item, temperature 0.6, 16k output tokens; can fall below 0; higher is better. Source: arxiv.org. Saturation forecast: Around August 2027. 18 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi K2.6 | 75.21 | #178 |
| 2 | Qwen 3.6 Max Preview | 75.12 | #159 |
| 3 | Qwen 3 Max | 74.35 | #403 |
| 4 | Kimi K2.5 | 73.4 | #256 |
| 5 | GLM-5.1 | 69.96 | #179 |
| 6 | Claude Sonnet 4.6 | 69.18 | #161 |
| 7 | Qwen 3.5 397B A17B | 68.03 | #246 |
| 8 | GLM-5 | 63.28 | #260 |
| 9 | DeepSeek V4 Flash | 63.19 | #258 |
| 10 | DeepSeek V4 Pro | 62.22 | #188 |
| 11 | DeepSeek V3.2 | 60.03 | #406 |
| 12 | DeepSeek R1 | 59.49 | #473 |
| 13 | GPT-5.2 | 56.43 | #176 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=lexrubric · How It Works · Data refreshed daily, snapshot 2026-11-13.