OLMo-7B-Instruct: benchmark results

Provider: Allen AI. Released 2024-02-23. Access: Open.

Unified ELO 1348 ± 1, rank #1274 of 1392 rated models, from 19 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench67.27Score (%)46.6
RewardBench Chat Hard50.66Accuracy (%)29.3
BiGGen-Bench2.97Average Score (1-5)28.4
RewardBench Chat89.66Accuracy (%)28.4
RewardBench Reasoning71.68Accuracy (%)26.6
RewardBench Prior Sets (0.5 weight)51.73Score (%)26
RewardBench Safety64.86Accuracy (%)18.2
BenchBench15.67Aggregate Score (%)14
MixEval26.7Score5.9
Chatbot Arena (Text - Multi-Turn)1042Arena Score3.8
Chatbot Arena (Text - Math)1053Arena Score3.7
Chatbot Arena (Text - English)1110Arena Score3.5

Interactive version: theaggregate.ai/model?slug=olmo-7b-instruct · How It Works · Data refreshed daily, snapshot 2026-09-05.