Olmo-3-7B-Instruct-DPO: benchmark results
Provider: Allen AI. Released 2025-11-20. Access: Open.
Aggregate Rating 1358 ± 28, rank #7495 of 10916 rated models, from 264 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Polish Summarization - PSC | 23.92 | chrF3++ (%) | 81 |
| EuroEval Portuguese NLU - ScaLA PT | 25.55 | Matthews correlation coefficient (%) | 80.2 |
| EuroEval English NLU - ScaLA EN | 51.83 | Matthews correlation coefficient (%) | 77.2 |
| EuroEval Italian NLU - ScaLA IT | 28.09 | Matthews correlation coefficient (%) | 73.9 |
| EuroEval Dutch Summarization - Wiki Lingua NL | 33.67 | chrF3++ (%) | 72 |
| EuroEval French NLU - ScaLA FR | 39.56 | Matthews correlation coefficient (%) | 66.5 |
| EuroEval Portuguese Summarization - Publico | 32.01 | chrF3++ (%) | 61.7 |
| EuroEval Catalan Summarization - Dacsa CA | 34.32 | chrF3++ (%) | 61 |
| EuroEval Spanish NLU - ScaLA ES | 20.18 | Matthews correlation coefficient (%) | 58.2 |
| EuroEval Catalan NLU - ScaLA CA | 11.48 | Matthews correlation coefficient (%) | 56.9 |
| EuroEval Spanish Summarization - Mlsum ES | 25.38 | chrF3++ (%) | 56.5 |
| EuroEval English Summarization - CNN Dailymail | 41.88 | chrF3++ (%) | 54.7 |
Interactive version: theaggregate.ai/model?slug=olmo-3-7b-instruct-dpo · How It Works · Data refreshed daily, snapshot 2026-11-08.