MMLU-by-task Leaderboard: leaderboard

MMLU-by-task leaderboard exposing per-subject MMLU performance plus an average score across many open-weight models.

Metric: MMLU Average (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1257 models tracked.

Top models

#ModelScoreOverall rank
1Llama 2 70B Base69.83#1025
2Xwin-LM-70B-V0.169.77#982
3Llama 2 70B Chat69.18#1237
4StableBeluga268.79#1078
5Mistral-7B-v0.164.16#1326
6WizardLM-70B-V1.064.05#1236
7Llama 2 70B Chat (HF)63.91#1264
8internlm-20B61.85#1296
9vicuna-33B-v1.359.22#1347
10vicuna-13B-v1.556.67#1392
11OpenHermes-13B56.35#1393
12falcon-40B Instruct55.45#1458
13MythoMax-L2-13B55.33#1409
14trurl-2-13B-academic55.2#1413
15Chinese-Alpaca-2-13B55.1#1414

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mmlu-by-task-leaderboard · How It Works · Data refreshed daily, snapshot 2026-10-20.