MMLU-CF 5-shot Test: leaderboard

MMLU-CF 5-shot Test — Official MMLU-CF contamination-free benchmark; 5-shot test cohort. Original MMLU column and test-minus-validation deltas are not independent capability panels. Native API/checkpoint labels retained. Metric: Accuracy (%). Source: https://github.com/microsoft/MMLU-CF

Metric: Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 44 models tracked. Updated 16 Nov 2026.

Top models

#ModelScoreOverall rank
1GPT-4o73.4#744
2Qwen 2.5 72B Instruct71.6#1095
3GPT-4 Turbo70.4#999
4Qwen 2.5 32B Instruct69.7#1232
5Llama 3 70B Instruct68.9#1689
6Llama 3.3 70B Instruct68.8#1379
7Llama 3.1 70B Instruct68.7#1542
8phi-4-14B67.8#1666
9Qwen 2.5 14B Instruct66.4#1750
10GPT-4o Mini65.5#1658
11Gemini 1.5 Flash64.8#1694
12Phi-3.5-MoE-instruct64.6#2199
13Phi-3-medium-128k-instruct64.2#3321
14Gemma 2 27B63.9#2141
15Qwen 2 72B Instruct63.7#1514

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=mmlu-cf-5-shot-test · How It Works · Data refreshed daily, snapshot 2026-11-16.