MMLU-by-task - Elementary Mathematics: leaderboard

The "Elementary Mathematics" subtask of MMLU-by-task. A single MMLU subject, reporting per-task multiple-choice accuracy from the MMLU-by-task leaderboard across a wide range of academic and professional domains.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1257 models tracked.

Top models

#ModelScoreOverall rank
1Llama 2 70B Chat45.5#1237
2Xwin-LM-70B-V0.145.5#982
3StableBeluga243.92#1078
4Llama 2 70B Base43.39#1025
5WizardLM-70B-V1.041.27#1236
6Llama 2 70B Chat (HF)41.01#1264
7internlm-20B39.95#1296
8vicuna-33B-v1.337.57#1347
9Mistral-7B-v0.137.3#1326
10OpenHermes-13B35.98#1393
11trurl-2-13B-academic35.45#1413
12Llama 2 13B Chat Base34.13#1422
13WizardLM-13B-V1.234.13#1425
14falcon-40B Instruct33.33#1458
15mpt-30B32.8#1476

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mmlu-by-task-elementary-mathematics · How It Works · Data refreshed daily, snapshot 2026-10-20.