MMLU-CF 5-shot Test: leaderboard
MMLU-CF 5-shot Test — Official MMLU-CF contamination-free benchmark; 5-shot test cohort. Original MMLU column and test-minus-validation deltas are not independent capability panels. Native API/checkpoint labels retained. Metric: Accuracy (%). Source: https://github.com/microsoft/MMLU-CF
Metric: Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 44 models tracked. Updated 16 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 73.4 | #744 |
| 2 | Qwen 2.5 72B Instruct | 71.6 | #1095 |
| 3 | GPT-4 Turbo | 70.4 | #999 |
| 4 | Qwen 2.5 32B Instruct | 69.7 | #1232 |
| 5 | Llama 3 70B Instruct | 68.9 | #1689 |
| 6 | Llama 3.3 70B Instruct | 68.8 | #1379 |
| 7 | Llama 3.1 70B Instruct | 68.7 | #1542 |
| 8 | phi-4-14B | 67.8 | #1666 |
| 9 | Qwen 2.5 14B Instruct | 66.4 | #1750 |
| 10 | GPT-4o Mini | 65.5 | #1658 |
| 11 | Gemini 1.5 Flash | 64.8 | #1694 |
| 12 | Phi-3.5-MoE-instruct | 64.6 | #2199 |
| 13 | Phi-3-medium-128k-instruct | 64.2 | #3321 |
| 14 | Gemma 2 27B | 63.9 | #2141 |
| 15 | Qwen 2 72B Instruct | 63.7 | #1514 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mmlu-cf-5-shot-test · How It Works · Data refreshed daily, snapshot 2026-11-16.