pythia-70m: benchmark results
Provider: EleutherAI. Access: Open.
Aggregate Rating 1118 ± 17, rank #10528 of 10916 rated models, from 73 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - High School Statistics | 46.76 | Accuracy (%) | 80.4 |
| MMLU-by-task - College Chemistry | 40 | Accuracy (%) | 73.8 |
| MMLU-by-task - College Physics | 28.43 | Accuracy (%) | 67.4 |
| MMLU-by-task - High School Mathematics | 28.52 | Accuracy (%) | 64.7 |
| MMLU-by-task - TruthfulQA MC2 | 47.06 | Accuracy (%) | 60.2 |
| MMLU-by-task - High School Physics | 29.14 | Accuracy (%) | 42.7 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 47.06 | MC2 (%) (0-shot) | 36.3 |
| MMLU-by-task - College Medicine | 29.48 | Accuracy (%) | 31.6 |
| MMLU-by-task - High School Macroeconomics | 33.08 | Accuracy (%) | 31 |
| MMLU-by-task - High School Chemistry | 28.08 | Accuracy (%) | 29.9 |
| MMLU-by-task - High School Government And Politics | 34.72 | Accuracy (%) | 29.2 |
| MMLU-by-task - Sociology | 27.86 | Accuracy (%) | 28 |
Interactive version: theaggregate.ai/model?slug=pythia-70m · How It Works · Data refreshed daily, snapshot 2026-11-08.