LexIssue - Legal Issue Classification Tier-3 (Knowledge-Base RAG): leaderboard
Metric: Weighted F1 (%; legal issue classification at Tier-3, the full hierarchical category path, counted only for aligned issues; predicted issues are aligned to the expert reference issues by a two-stage Qwen-3.5-27B judge (semantic retrieval, then rubric-based equivalence verification); mean case-level weighted F1 over the 430 cases; retrieval-augmented setting: the top 5 entries of the authors' 441-entry legal issue knowledge base for the case's cause of action, reranked by Qwen3-Reranker-8B, are added to the prompt). Source: arxiv.org. Saturation forecast: Around September 2028. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash | 33.9 |
| 2 | DeepSeek V4 Flash | 29.5 |
| 3 | GPT-5.2 | 24.3 |
| 4 | Qwen 3 8B | 13.1 |
Interactive version: theaggregate.ai/benchmark?slug=lexissue-legal-issue-classification-tier-3-knowledge-base-rag · How It Works · Data refreshed daily, snapshot 2026-09-26.