OLMo-7B-Instruct — benchmark results

Provider: Allen AI. Released 2024-02-23. Access: Open.

Unified ELO 1317 ± 27, rank #1499 of 1776 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench67.27Score (%)46.6
RewardBench Chat Hard50.66Accuracy (%)29.3
BiGGen-Bench2.97Average Score (1-5)28.4
RewardBench Chat89.66Accuracy (%)28.4
RewardBench Reasoning71.68Accuracy (%)26.6
RewardBench Prior Sets (0.5 weight)51.73Score (%)26
RewardBench Safety64.86Accuracy (%)18.2
BenchBench15.67Aggregate Score (%)14
MixEval26.7Score5.9
Chatbot Arena (Text)1073Elo3.5

Interactive version: theaggregate.ai/model?slug=olmo-7b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.