LexIssue - Legal Issue Classification Tier-3: leaderboard

Metric: Weighted F1 (%; legal issue classification at Tier-3, the full hierarchical category path, counted only for aligned issues; predicted issues are aligned to the expert reference issues by a two-stage Qwen-3.5-27B judge (semantic retrieval, then rubric-based equivalence verification); mean case-level weighted F1 over the 430 cases; zero-shot prompting with task instructions only). Source: arxiv.org. Saturation forecast: Around April 2028. 8 models tracked.

Top models

#ModelScore
1Gemini 3 Flash35.7
2DeepSeek V4 Flash20.4
3GPT-5.218.5
4Qwen 3 8B9.8

Interactive version: theaggregate.ai/benchmark?slug=lexissue-legal-issue-classification-tier-3 · How It Works · Data refreshed daily, snapshot 2026-09-26.