PIJ - Criminal Process Reconstruction: leaderboard
F1 for criminal process reconstruction on the PIJ human-comparison subset of 50 samples per task, including Unknown labels. These are the human-comparison results rather than the full 2,500-case headline evaluation.
Metric: F1 (%, 50-sample human evaluation, include Unknown). Source: arxiv.org. Saturation forecast: Around 2031. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 60.06 | #103 |
| 2 | Qwen 3 Max | 59.51 | #213 |
| 3 | Qwen 3 14B | 55.96 | #542 |
| 4 | GPT-5.4 | 55.84 | #83 |
| 5 | GPT-5.4 Mini | 54.85 | #228 |
| 6 | Claude Sonnet 4.6 | 54.32 | #94 |
| 7 | DeepSeek V4 Pro (Non-reasoning) | 53.19 | #112 (DeepSeek V4 Pro) |
| 8 | DeepSeek V4 Pro (Reasoning) | 50.09 | #112 (DeepSeek V4 Pro) |
| 9 | Llama 3.3 70B | 49.09 | #578 |
| 10 | Qwen 3 8B | 49.07 | #678 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=pij-criminal-process-reconstruction · How It Works · Data refreshed daily, snapshot 2026-11-05.