Open LLM Leaderboard v1 - MMLU: leaderboard

Original Hugging Face Open LLM Leaderboard academic knowledge across the 57 MMLU subjects, with five demonstrations and the published subject-aggregate accuracy. Percentage, higher is better. Frozen v1 archive, distinct from MMLU-Pro in v2. Public test questions may overlap model training.

Metric: Accuracy (%) (5-shot). Source: huggingface.co. Saturation forecast: Estimated already saturated. 7252 models tracked.

Top models

#ModelScoreOverall rank
134B-beta85.6#895
2Qwen 2 72B83.79#517
3Llama 3 70B Japanese Suzume Vector V0.180.28#774
4Qwen 1.5 110B80.2#735
5autotrain-llama3-70B-orpo-v180.11#844
6Llama 3 70B Instruct80.06#643
7Llama3-TenyxChat-70B80.04#739
8Llama 3 70B79.23#635
9Llama 3 70B Fireplace78.97#847
10YiSM-34B-0rn78.51#715
11Yi-1.5-34B-32K78.15#1107
12blossom-v5.1-34B78.05#782
13Qwen 1.5 110B Chat78.04#695
14Yi 1.5 34B78#808
15free-evo-qwen72B-v0.8-re78#442

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-llm-leaderboard-v1-mmlu · How It Works · Data refreshed daily, snapshot 2026-11-07.