pythia-70m-deduped-cleansharegpt: benchmark results
Provider: EleutherAI. Access: Open.
Aggregate Rating 1117 ± 16, rank #10541 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - TruthfulQA MC2 | 51.15 | Accuracy (%) | 81.2 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 51.15 | MC2 (%) (0-shot) | 50.8 |
| MMLU-by-task - Machine Learning | 31.25 | Accuracy (%) | 43.7 |
| MMLU-by-task - Formal Logic | 28.57 | Accuracy (%) | 41.7 |
| MMLU-by-task - World Religions | 32.16 | Accuracy (%) | 28 |
| MMLU-by-task - TruthfulQA MC1 | 24.48 | Accuracy (%) | 27.7 |
| MMLU-by-task - Business Ethics | 30 | Accuracy (%) | 26.7 |
| MMLU-by-task - Marketing | 29.06 | Accuracy (%) | 26.1 |
| MMLU-by-task - College Physics | 21.57 | Accuracy (%) | 25.7 |
| MMLU-by-task - Medical Genetics | 30 | Accuracy (%) | 25.6 |
| MMLU-by-task - US Foreign Policy | 28 | Accuracy (%) | 22.2 |
| MMLU-by-task - Human Aging | 31.39 | Accuracy (%) | 21.7 |
Interactive version: theaggregate.ai/model?slug=pythia-70m-deduped-cleansharegpt · How It Works · Data refreshed daily, snapshot 2026-11-08.