pythia-2.8B-deduped: benchmark results
Provider: EleutherAI. Released 2023-04-03. Access: Open.
Aggregate Rating 1135 ± 15, rank #10218 of 10916 rated models, from 84 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - High School Statistics | 44.91 | Accuracy (%) | 73.4 |
| MMLU-by-task - High School Physics | 31.79 | Accuracy (%) | 61.3 |
| MMLU-by-task - Global Facts | 33 | Accuracy (%) | 51.6 |
| MMLU-by-task - College Chemistry | 30 | Accuracy (%) | 40.7 |
| MMLU-by-task - High School Mathematics | 26.3 | Accuracy (%) | 40 |
| MMLU-by-task - Professional Medicine | 43.38 | Accuracy (%) | 38.7 |
| MMLU-by-task - College Mathematics | 30 | Accuracy (%) | 38.1 |
| MMLU-by-task - Abstract Algebra | 27 | Accuracy (%) | 34 |
| MMLU-by-task - Public Relations | 35.45 | Accuracy (%) | 33 |
| MMLU-by-task - Elementary Mathematics | 26.46 | Accuracy (%) | 32.7 |
| MMLU-by-task - High School European History | 28.48 | Accuracy (%) | 30.2 |
| MMLU-by-task - High School Macroeconomics | 32.05 | Accuracy (%) | 29.4 |
Interactive version: theaggregate.ai/model?slug=pythia-2-8b-deduped · How It Works · Data refreshed daily, snapshot 2026-11-08.