LongJud-Bench - Party Identification (First Instance): leaderboard

LongJud-Bench (LegalWorld, Zuo et al., 2026) makes a model the target lawyer in a simulated Chinese civil case, from client consultation to second-instance trial, with every other role played by Qwen3.5-Plus on a 100-case split. Party identification is scored on the first-instance complaint or defense the agent drafts, by exact match of its party identity and procedural slots against the case record, normalized to percent; higher is better.

Metric: Party Identification Score (%; exact match of party identity and procedural slots in the first-instance complaint or defense, normalized). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.580#252
2Qwen 3.5 Plus71#227
3DeepSeek V4 Flash64#254
4GLM-4.756#365
5GPT-5.253#172
6Qwen 3.5 Flash46#443

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=longjud-bench-party-identification-first-instance · How It Works · Data refreshed daily, snapshot 2026-11-12.