Pythia-Chat-Base-7B: benchmark results
Provider: EleutherAI. Access: Open.
Aggregate Rating 1153 ± 16, rank #9927 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Abstract Algebra | 37 | Accuracy (%) | 94.5 |
| MMLU-by-task - Global Facts | 36 | Accuracy (%) | 70 |
| MMLU-by-task - Machine Learning | 36.61 | Accuracy (%) | 68 |
| MMLU-by-task - Econometrics | 29.82 | Accuracy (%) | 62.1 |
| MMLU-by-task - College Computer Science | 37 | Accuracy (%) | 46.6 |
| MMLU-by-task - High School Computer Science | 36 | Accuracy (%) | 38.2 |
| MMLU-by-task - College Mathematics | 30 | Accuracy (%) | 38.1 |
| MMLU-by-task - Formal Logic | 26.98 | Accuracy (%) | 35.6 |
| MMLU-by-task - Professional Psychology | 30.23 | Accuracy (%) | 34.6 |
| MMLU-by-task - Anatomy | 34.07 | Accuracy (%) | 33.8 |
| MMLU-by-task - High School US History | 29.41 | Accuracy (%) | 33 |
| MMLU-by-task - High School European History | 29.7 | Accuracy (%) | 32.8 |
Interactive version: theaggregate.ai/model?slug=pythia-chat-base-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.