OLMo-2-1124-7B: benchmark results
Provider: Allen AI. Released 2024-11-26. Access: Open.
Unified ELO 1341 ± 23, rank #1386 of 1632 rated models, from 198 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval French NLU - FQuAD | 76.56 | Reading comprehension Score (%) | 98.7 |
| EuroEval English NLU - SQuAD | 87.82 | Reading comprehension Score (%) | 95.7 |
| EuroEval Spanish NLU - MLQA ES | 69.06 | Reading comprehension Score (%) | 95.4 |
| LA Leaderboard - XL-Sum Spanish | 3.59 | BLEU | 94 |
| LA Leaderboard - MGSM Spanish | 10 | Exact Match (%) | 93.8 |
| LA Leaderboard - CatalanQA | 82.12 | F1 (%) | 92.3 |
| LA Leaderboard - XQuAD Catalan | 73.66 | F1 (%) | 92.3 |
| LA Leaderboard - XQuAD Spanish | 76.04 | F1 (%) | 92.3 |
| EuroEval German NLU - Germanquad | 66.81 | Reading comprehension Score (%) | 91.9 |
| EuroEval English NLU - SST-5 | 69.18 | Sentiment classification Score (%) | 91.6 |
| LA Leaderboard - WNLI Spanish | 69.01 | Accuracy (%) | 89.7 |
| LA Leaderboard - MGSM Galician | 8.8 | Exact Match (%) | 88.5 |
Interactive version: theaggregate.ai/model?slug=olmo-2-1124-7b · How It Works · Data refreshed daily, snapshot 2026-10-08.