HELM MMLU - Machine Learning: leaderboard

The "Machine Learning" subtask of HELM MMLU. HELM Classic MMLU group leaderboard from the public HELM release artifacts.

Metric: EM. Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 79 models tracked.

Top models

#ModelScoreOverall rank
1Claude 3.5 Sonnet (20241022)83.93#291
2Gemini 1.5 Pro (002)83.04#350
3Llama 3.1 405B Instruct79.46#461
4Claude 3.5 Sonnet (20240620)78.57#298
5DeepSeek V378.57#323
6Qwen 2.5 72B Instruct77.68#458
7GPT-4o (2024-08-06)77.68#335
8GPT-4o (2024-05-13)76.79#326
9Qwen 2 72B Instruct76.79#579
10Gemini 2.0 Flash (Preview)75.89#366
11GPT-4 (0613)75.89#494
12GPT-4 Turbo74.11#406
13Claude 3 Opus (20240229)74.11#413
14GPT-4 Turbo (Preview)72.32#399
15Llama 3.3 70B Instruct71.43#536

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-mmlu-machine-learning · How It Works · Data refreshed daily, snapshot 2026-10-23.