MMLU-CF 0-shot Validation: leaderboard
MMLU-CF 0-shot Validation — Official MMLU-CF contamination-free benchmark; 0-shot validation cohort. Original MMLU column and test-minus-validation deltas are not independent capability panels. Native API/checkpoint labels retained. Metric: Accuracy (%). Source: https://github.com/microsoft/MMLU-CF
Metric: Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 44 models tracked. Updated 16 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 72.4 | #744 |
| 2 | Qwen 2.5 72B Instruct | 70.4 | #1095 |
| 3 | Llama 3.1 70B Instruct | 69.7 | #1542 |
| 4 | phi-4-14B | 69.4 | #1666 |
| 5 | Qwen 2.5 32B Instruct | 68.8 | #1232 |
| 6 | GPT-4 Turbo | 68.7 | #999 |
| 7 | Llama 3.3 70B Instruct | 67.5 | #1379 |
| 8 | Llama 3 70B Instruct | 67.4 | #1689 |
| 9 | Qwen 2.5 14B Instruct | 66 | #1750 |
| 10 | GPT-4o Mini | 65.3 | #1658 |
| 11 | Mixtral 8x22B Instruct | 64.8 | #2097 |
| 12 | Gemma 2 27B | 64 | #2141 |
| 13 | Phi-3-medium-128k-instruct | 62.7 | #3321 |
| 14 | Qwen 2 72B Instruct | 62.5 | #1514 |
| 15 | Phi-3.5-MoE-instruct | 62.1 | #2199 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mmlu-cf-0-shot-validation · How It Works · Data refreshed daily, snapshot 2026-11-16.