LexRubric - Judicial Examination: leaderboard

LexRubric (2026) scores open-ended answers to 649 Chinese legal questions from everyday legal consultation and judicial examination against expert-written atomic rubric items, each checked by an LLM judge. This board covers the 176 judicial examination instances. The score rate is earned rubric points (negative items subtract) over the maximum positive score in percent, averaged over instances; higher is better.

Metric: Judicial examination (176 instances) score rate (%): points earned from expert-written atomic rubric items (weighted -10 to +10; negative items subtract) divided by the maximum positive score, averaged over instances; a Qwen3.6-27B judge checks each item, temperature 0.6, 16k output tokens; can fall below 0; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 18 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.681.59#178
2Qwen 3 Max80.99#403
3Kimi K2.580.39#256
4Qwen 3.6 Max Preview80.35#159
5GLM-5.176.37#179
6Qwen 3.5 397B A17B73.88#246
7DeepSeek V4 Pro72.93#188
8GLM-572.04#260
9DeepSeek V3.270.96#406
10Claude Sonnet 4.666.73#161
11DeepSeek V4 Flash64.67#258
12DeepSeek R162.86#473
13GPT-5.254.28#176

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=lexrubric-judicial-examination · How It Works · Data refreshed daily, snapshot 2026-11-13.