OLMo-7B-Instruct: benchmark results

Provider: Allen AI. Released 2024-02-23. Access: Open.

Aggregate Rating 1285 ± 29, rank #8917 of 10916 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench Chat Hard50.66Accuracy (%)29.3
BiGGen-Bench2.97Average Score (1-5)28.4
RewardBench Chat89.66Accuracy (%)28.4
RewardBench Safety64.86Accuracy (%)27.3
RewardBench Reasoning71.68Accuracy (%)26.6
RewardBench67.27Score (%)25.6
RewardBench Prior Sets (0.5 weight)51.73Score (%)20.6
BenchBench15.67Aggregate Score (%)14
MixEval26.7Score5.9
Chatbot Arena (Text - Business, Management & Financial Ops)1087Arena Score4.4
Chatbot Arena (Text - Math)1053Arena Score3.5
Chatbot Arena (Text - Multi-Turn)1042Arena Score3.5

Interactive version: theaggregate.ai/model?slug=olmo-7b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.