pythia-410m: benchmark results
Provider: EleutherAI. Access: Open.
Unified ELO 1262 ± 58, rank #2555 of 2656 rated models, from 11 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Portuguese LLM - BLUEX | 23.64 | Accuracy (%) | 17.4 |
| Open Portuguese LLM - FaQuAD NLI | 43.97 | Macro F1 (%) | 17.1 |
| Open LLM Leaderboard - MuSR | 35.78 | Score | 16.7 |
| Open LLM Leaderboard - IFEval | 21.95 | Score | 14.8 |
| Open Portuguese LLM - OAB Exams | 24.56 | Accuracy (%) | 13.5 |
| Open LLM Leaderboard - GPQA | 25.92 | Score | 11.8 |
| Open Portuguese LLM - ENEM | 19.8 | Accuracy (%) | 11.5 |
| Open LLM Leaderboard - MATH Level 5 | 0.98 | Score | 7 |
| Open LLM Leaderboard - BBH | 30.28 | Score | 5.7 |
| Open Portuguese LLM - ASSIN2 RTE | 33.33 | Macro F1 (%) | 4.9 |
| Open LLM Leaderboard - MMLU-Pro | 11.28 | Score | 4.4 |
Interactive version: theaggregate.ai/model?slug=pythia-410m · How It Works · Data refreshed daily, snapshot 2026-09-19.