MMLU-by-task - Elementary Mathematics: leaderboard

Metric: Accuracy (%). Source: huggingface.co. 1257 models tracked.

Top models

#ModelScore
1Llama 2 70B Chat45.5
2Llama 2 70B Base43.39
3Llama 2 70B Chat (HF)41.01
4LLaMA-65B40.48
5vicuna-33B-v1.337.57
6Mistral-7B-v0.137.3
7LLaMA-30B37.3
8Llama 2 13B Chat Base34.13
9mpt-30B32.8
10vicuna-7B-v1.332.54
11vicuna-13B-v1.532.54
12mpt-30B Instruct32.01
13ChatGLM2 6B31.75
14CodeLlama-34B-Python-hf31.48
15vicuna-13B30.95

Interactive version: theaggregate.ai/benchmark?slug=mmlu-by-task-elementary-mathematics · How It Works · Data refreshed daily, snapshot 2026-09-05.