PIJ - Criminal Process Summarization: leaderboard
BERTScore for criminal process summarization on the PIJ human-comparison subset of 50 samples per task, including Unknown labels. These are the human-comparison results rather than the full 2,500-case headline evaluation.
Metric: BERTScore (%, 50-sample human evaluation, include Unknown). Source: arxiv.org. Saturation forecast: Not forecast. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.4 Mini | 45.47 | #228 |
| 2 | GPT-5.4 | 45.27 | #83 |
| 3 | Qwen 3 14B | 44.87 | #542 |
| 4 | DeepSeek V4 Pro (Non-reasoning) | 44.81 | #112 (DeepSeek V4 Pro) |
| 5 | Qwen 3 Max | 44.23 | #213 |
| 6 | Gemini 3 Flash | 44.21 | #103 |
| 7 | Qwen 3 8B | 42.99 | #678 |
| 8 | Claude Sonnet 4.6 | 41.64 | #94 |
| 9 | DeepSeek V4 Pro (Reasoning) | 39.27 | #112 (DeepSeek V4 Pro) |
| 10 | Llama 3.3 70B | 7.36 | #578 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=pij-criminal-process-summarization · How It Works · Data refreshed daily, snapshot 2026-11-05.