LexIssue - Legal Issue Generation: leaderboard

Legal issue generation in LexIssue (Xie et al., 2026): from synthesized claim and defence forms of 430 real Chinese first-instance civil cases, the model states the disputed legal issues in free form. Case-level weighted F1 in percent against 1,303 expert-annotated issues after alignment by a Qwen-3.5-27B judge, zero-shot; higher is better.

Metric: Weighted F1 (%; legal issue generation: free-form disputed-issue descriptions matched to the 1,303 reference issues; predicted issues are aligned to the expert reference issues by a two-stage Qwen-3.5-27B judge (semantic retrieval, then rubric-based equivalence verification); mean case-level weighted F1 over the 430 cases; zero-shot prompting with task instructions only). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash70.1#159
2DeepSeek V4 Flash58.3#254
3GPT-5.254.2#172
4Qwen 3 8B46.4#1838

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=lexissue-legal-issue-generation · How It Works · Data refreshed daily, snapshot 2026-11-12.