OLMo 2 7B: benchmark results
Provider: Allen AI. Released 2024-11-01. Access: Open.
Unified ELO 1364 ± 1, rank #1233 of 1392 rated models, from 22 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA Humanity's Last Exam | 5.38 | Accuracy (%) | 35.2 |
| MIST (Selective Trust) | 68.1 | Overall Accuracy (%) | 22.7 |
| Artificial Analysis Intelligence Index | 1 | Intelligence Index | 9.4 |
| AA IFBench | 24.42 | Accuracy (%) | 6.7 |
| AA Long Context Reasoning | 0 | Accuracy (%) | 6.1 |
| AA Terminal-Bench Hard | 0 | Accuracy (%) | 5.5 |
| AI for Education Pedagogy - Technology | 47.17 | Accuracy (%) | 5.3 |
| AA GPQA Diamond | 28.79 | Accuracy (%) | 4.9 |
| AI for Education SEND | 46.33 | Accuracy (%) | 4.3 |
| AI for Education Pedagogy - Science | 33.33 | Accuracy (%) | 4 |
| AI for Education Pedagogy | 36.48 | Accuracy (%) | 3.8 |
| AI for Education Pedagogy - Primary | 36.15 | Accuracy (%) | 3.8 |
Interactive version: theaggregate.ai/model?slug=olmo-2-7b · How It Works · Data refreshed daily, snapshot 2026-09-05.