pythia-6.9B-deduped: benchmark results
Provider: EleutherAI. Access: Open.
Aggregate Rating 1142 ± 15, rank #10075 of 10916 rated models, from 73 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - High School Statistics | 44.91 | Accuracy (%) | 73.4 |
| MMLU-by-task - High School Physics | 31.13 | Accuracy (%) | 56.1 |
| MMLU-by-task - Machine Learning | 33.04 | Accuracy (%) | 53.4 |
| MMLU-by-task - High School Mathematics | 26.67 | Accuracy (%) | 45.9 |
| MMLU-by-task - College Mathematics | 31 | Accuracy (%) | 45.5 |
| MMLU-by-task - High School Chemistry | 30.54 | Accuracy (%) | 42.1 |
| MMLU-by-task - College Computer Science | 35 | Accuracy (%) | 42 |
| MMLU-by-task - Virology | 34.94 | Accuracy (%) | 37.7 |
| MMLU-by-task - Logical Fallacies | 31.29 | Accuracy (%) | 34.1 |
| MMLU-by-task - Abstract Algebra | 27 | Accuracy (%) | 34 |
| MMLU-by-task - Human Aging | 37.67 | Accuracy (%) | 33.2 |
| MMLU-by-task - Electrical Engineering | 30.34 | Accuracy (%) | 32.9 |
Interactive version: theaggregate.ai/model?slug=pythia-6-9b-deduped · How It Works · Data refreshed daily, snapshot 2026-11-08.