LongJud-Bench - Issue Spotting: leaderboard

LongJud-Bench (LegalWorld, Zuo et al., 2026) makes a model the target lawyer in a simulated Chinese civil case, from client consultation to second-instance trial, with every other role played by Qwen3.5-Plus on a 100-case split. Issue spotting is the consultation-stage capability: a Claude Sonnet 4.6 judge scores each answer to the client's legal questions against a reference on legal relationship, applicable rules, risk explanation and actionable advice (0-10 each), normalized to percent; higher is better.

Metric: Legal Consultation Score (%; Claude Sonnet 4.6 judge, four 0-10 rubric dimensions per client question, normalized). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.567#252
2GPT-5.263#172
3DeepSeek V4 Flash62#254
4Qwen 3.5 Plus62#227
5Qwen 3.5 Flash56#443
6GLM-4.754#365

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=longjud-bench-issue-spotting · How It Works · Data refreshed daily, snapshot 2026-11-12.