MMLU-by-task - High School Chemistry: leaderboard

The "High School Chemistry" subtask of MMLU-by-task. A single MMLU subject, reporting per-task multiple-choice accuracy from the MMLU-by-task leaderboard across a wide range of academic and professional domains.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1257 models tracked.

Top models

#ModelScoreOverall rank
1Xwin-LM-70B-V0.155.17#982
2Llama 2 70B Chat54.68#1237
3Mistral-7B-v0.152.71#1326
4Llama 2 70B Base51.23#1025
5StableBeluga250.25#1078
6WizardLM-70B-V1.048.77#1236
7OpenHermes-13B48.28#1393
8internlm-20B48.28#1296
9Llama 2 70B Chat (HF)46.31#1264
10Llama 2 13B Chat Base46.31#1422
11ChatGLM2 6B45.32#1498
12Chinese-Alpaca-2-13B44.83#1414
13trurl-2-13B-academic44.33#1413
14WizardLM-13B-V1.243.84#1425
15vicuna-13B-v1.543.84#1392

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mmlu-by-task-high-school-chemistry · How It Works · Data refreshed daily, snapshot 2026-10-20.