Olmo 3.1 32B Instruct: benchmark results
Ai2's 32B instruct model from the fully open Olmo 3.1 update, scaling the Olmo 3 SFT+DPO+RLVR chat recipe up from 7B (December 2025). Provider: Allen AI. Released 2025-12-12. Access: Open.
Aggregate Rating 1506 ± 10, rank #763 of 1656 rated models, from 717 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| CarryOnBench - Harmfulness (Turn 1) | 1.3 | Harmfulness (1-5): GPT-5.2 rates each response for harmful o | 100 |
| AGC-Bench - story_generation_rocstories | 3.29 | Dataset z-score | 98.8 |
| EuroEval Catalan NLU - MultiWikiQA CA | 77.23 | Character F1 (%) | 97.2 |
| AGC-Bench - proparalogy | 0.87 | Dataset z-score | 96.3 |
| EuroEval Dutch Summarization - Wiki Lingua NL | 34.91 | chrF3++ (%) | 91.3 |
| EuroEval English NLU - ScaLA EN | 60.51 | Matthews correlation coefficient (%) | 90.4 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 76.18 | Character F1 (%) | 89.6 |
| AGC-Bench - story_quality | 1.11 | Dataset z-score | 89.5 |
| EuroEval Portuguese NLU | 60.63 | NLU Average Score (%) | 89.1 |
| EuroEval Portuguese NLU - ScaLA PT | 38.51 | Matthews correlation coefficient (%) | 88.9 |
| EuroEval Dutch NLU - DBRD | 91.44 | Matthews correlation coefficient (%) | 87.1 |
| EuroEval Italian NLU - ScaLA IT | 41.26 | Matthews correlation coefficient (%) | 87.1 |
Interactive version: theaggregate.ai/model?slug=olmo-3-1-32b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.