LongJud-Bench - Claim Construction (First Instance): leaderboard

LongJud-Bench (LegalWorld, Zuo et al., 2026) makes a model the target lawyer in a simulated Chinese civil case, from client consultation to second-instance trial, with every other role played by Qwen3.5-Plus on a 100-case split. Claim construction is scored on the claims or defenses in the first-instance complaint or defense the agent drafts, by a Claude Sonnet 4.6 judge on a 0-10 rubric, normalized to percent; higher is better.

Metric: Claim Construction Score (%; Claude Sonnet 4.6 judge, 0-10 rubric on the claims or defenses in the first-instance complaint or defense, normalized). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 Plus72#227
2Kimi K2.569#252
3GLM-4.766#365
4DeepSeek V4 Flash65#254
5GPT-5.260#172
6Qwen 3.5 Flash56#443

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=longjud-bench-claim-construction-first-instance · How It Works · Data refreshed daily, snapshot 2026-11-12.