pythia-2.7B: benchmark results
Provider: EleutherAI.
Aggregate Rating 1140 ± 15, rank #10120 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Econometrics | 28.95 | Accuracy (%) | 55.2 |
| MMLU-by-task - Moral Scenarios | 24.69 | Accuracy (%) | 38.9 |
| MMLU-by-task - Global Facts | 31 | Accuracy (%) | 36.8 |
| MMLU-by-task - Machine Learning | 29.46 | Accuracy (%) | 35.2 |
| MMLU-by-task - Philosophy | 33.44 | Accuracy (%) | 33.8 |
| MMLU-by-task - Public Relations | 35.45 | Accuracy (%) | 33 |
| MMLU-by-task - College Mathematics | 29 | Accuracy (%) | 32.7 |
| MMLU-by-task - Elementary Mathematics | 26.46 | Accuracy (%) | 32.7 |
| MMLU-by-task - Professional Accounting | 27.66 | Accuracy (%) | 30.6 |
| MMLU-by-task - College Biology | 28.47 | Accuracy (%) | 30.5 |
| MMLU-by-task - Human Aging | 35.87 | Accuracy (%) | 30.5 |
| MMLU-by-task - International Law | 36.36 | Accuracy (%) | 29.2 |
Interactive version: theaggregate.ai/model?slug=pythia-2-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.