OLMo 2 32B — benchmark results

Provider: Allen AI. Released 2024-11-01. Access: Open.

Unified ELO 1177 ± 102, rank #1773 of 1841 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA IFBench38.1Accuracy (%)33.6
AI for Education SEND62.39Accuracy (%)18.6
AI for Education Pedagogy - Maths55.56Accuracy (%)17.7
AI for Education Pedagogy - Social studies57.27Accuracy (%)16.4
AA MMLU-Pro51.06Accuracy (%)15.4
Artificial Analysis Intelligence Index5.01Intelligence Index15.1
AI for Education Pedagogy58.51Accuracy (%)14.8
AI for Education Pedagogy - Primary61.03Accuracy (%)14.1
AI for Education Pedagogy - Secondary56.6Accuracy (%)13.9
AI for Education Pedagogy - Science56.28Accuracy (%)13.5
AA GPQA Diamond32.83Accuracy (%)10.9
AI for Education Pedagogy - Technology60.38Accuracy (%)10.8

Interactive version: theaggregate.ai/model?slug=olmo-2-32b · How It Works · Data refreshed daily, snapshot 2026-07-25.