ExpertLongBench (Checklist Accuracy): leaderboard
ExpertLongBench v1 (arXiv:2506.01241v3): mean CLEAR structured-checklist accuracy (0-100%) across 11 expert-level long-form generation tasks spanning 9 domains (outputs up to >5,000 tokens, greedy decoding temp=0); higher is better.
Metric: Mean Checklist Accuracy (%). Source: huggingface.co. Saturation forecast: Around 2032. 13 models tracked. Updated 21 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 29.3 | #276 |
| 2 | GPT-5 | 27.1 | #178 |
| 3 | GPT-4o (2024-11-20) | 23.9 | #859 |
| 4 | Gemini 2.0 Flash | 23.6 | #723 |
| 5 | GPT-4o Mini (2024-07-18) | 23.6 | #1484 |
| 6 | Llama 3.3 70B Instruct | 22.4 | #1385 |
| 7 | Mistral Nemo Instruct (2407) | 22 | #3118 |
| 8 | Mistral Large 2 (Nov) Instruct (2411) | 21.9 | #1217 |
| 9 | Qwen 2.5 72B | 21.5 | #1188 |
| 10 | Llama 3.1 8B Instruct | 21.3 | #4600 |
| 11 | Claude 3.7 Sonnet | 21 | #470 |
| 12 | Qwen 2.5 7B | 18.7 | #2929 |
| 13 | Claude 3.5 Haiku | 18 | #1580 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=expertlongbench-checklist-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-21.