Olmo 3.1 32B: benchmark results
Provider: Allen AI. Released 2025-12-12.
Aggregate Rating 1447 ± 38, rank #3894 of 10916 rated models, from 6 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| SEA-HELM | 40.88 | Mean Score (%) | 14 |
| CodeMixQA | 6.59 | SimpleQA F1 (%), mean of 4 code-switching perturbations | 10 |
| CodeMixQA - Grammar Forcing (Src) | 6.58 | SimpleQA F1 (%) | 10 |
| CodeMixQA - Grammar Forcing (Tgt) | 6.58 | SimpleQA F1 (%) | 10 |
| CodeMixQA - Random Switching | 6.44 | SimpleQA F1 (%) | 10 |
| CodeMixQA - Selective Switching | 6.76 | SimpleQA F1 (%) | 10 |
Interactive version: theaggregate.ai/model?slug=olmo-3-1-32b-1bdj0ij · How It Works · Data refreshed daily, snapshot 2026-11-08.