OLMo-2-1124-7B — benchmark results
Provider: Allen AI. Released 2024-11-24. Access: Open.
Unified ELO 1386 ± 14, rank #1280 of 1776 rated models, from 112 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval French NLU - FQuAD | 76.56 | Reading comprehension Score (%) | 98.7 |
| EuroEval English NLU - SQuAD | 87.82 | Reading comprehension Score (%) | 95.7 |
| EuroEval Spanish NLU - MLQA ES | 69.06 | Reading comprehension Score (%) | 95.4 |
| EuroEval German NLU - Germanquad | 66.81 | Reading comprehension Score (%) | 91.9 |
| EuroEval English NLU - SST-5 | 69.18 | Sentiment classification Score (%) | 91.6 |
| EuroEval Dutch NLU - SQuAD NL | 77.19 | Reading comprehension Score (%) | 81.9 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 74.45 | Reading comprehension Score (%) | 81.8 |
| EuroEval Finnish NLU - Tydiqa FI | 68.53 | Reading comprehension Score (%) | 80.2 |
| EuroEval Swedish NLU - Swerec | 77.67 | Sentiment classification Score (%) | 78.4 |
| EuroEval Icelandic NLU - NQII | 50.99 | Reading comprehension Score (%) | 71.8 |
| LA Leaderboard - GalCoLA | 52.9 | Accuracy (%) | 69.1 |
| EuroEval Italian NLU - SQuAD IT | 69.27 | Reading comprehension Score (%) | 64.6 |
Interactive version: theaggregate.ai/model?slug=olmo-2-1124-7b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.