pythia-6.7B: benchmark results
Provider: EleutherAI.
Aggregate Rating 1135 ± 16, rank #10212 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Elementary Mathematics | 27.78 | Accuracy (%) | 45.3 |
| MMLU-by-task - Global Facts | 31 | Accuracy (%) | 36.8 |
| MMLU-by-task - Conceptual Physics | 33.62 | Accuracy (%) | 35.8 |
| MMLU-by-task - College Physics | 22.55 | Accuracy (%) | 34.3 |
| MMLU-by-task - Abstract Algebra | 27 | Accuracy (%) | 34 |
| MMLU-by-task - Business Ethics | 34 | Accuracy (%) | 33.2 |
| MMLU-by-task - Econometrics | 26.32 | Accuracy (%) | 32.9 |
| MMLU-by-task - College Medicine | 29.48 | Accuracy (%) | 31.6 |
| MMLU-by-task - Professional Psychology | 27.94 | Accuracy (%) | 30.8 |
| MMLU-by-task - ARC Challenge | 36.86 | Accuracy (%) | 27.5 |
| MMLU-by-task - Professional Law | 26.6 | Accuracy (%) | 27.5 |
| MMLU-by-task - Jurisprudence | 28.7 | Accuracy (%) | 27.3 |
Interactive version: theaggregate.ai/model?slug=pythia-6-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.