LexIssue - Legal Issue Classification Tier-3: leaderboard
Legal issue classification in LexIssue (Xie et al., 2026): every disputed issue the model identifies must also carry the correct category of the hierarchical legal issue schema, scored at Tier-3, where the full category path must match. Case-level weighted F1 in percent over 430 Chinese civil cases, counting only issues aligned with the expert reference by a Qwen-3.5-27B judge, zero-shot; higher is better.
Metric: Weighted F1 (%; legal issue classification at Tier-3, the full hierarchical category path, counted only for aligned issues; predicted issues are aligned to the expert reference issues by a two-stage Qwen-3.5-27B judge (semantic retrieval, then rubric-based equivalence verification); mean case-level weighted F1 over the 430 cases; zero-shot prompting with task instructions only). Source: arxiv.org. Saturation forecast: Around July 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 35.7 | #159 |
| 2 | DeepSeek V4 Flash | 20.4 | #254 |
| 3 | GPT-5.2 | 18.5 | #172 |
| 4 | Qwen 3 8B | 9.8 | #1838 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=lexissue-legal-issue-classification-tier-3 · How It Works · Data refreshed daily, snapshot 2026-11-12.