OLMo-1B-hf [bfloat16] [rev: e005c9593b71]: benchmark results

Provider: Allen AI. Access: Open.

Aggregate Rating 1154 ± 34, rank #9904 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K1.9Accuracy (%) (5-shot)18.7
Open LLM Leaderboard v1 - HellaSwag63.6Normalized accuracy (%) (10-shot)16.6
Open LLM Leaderboard v1 - WinoGrande61.09Accuracy (%) (5-shot)14.2
Open LLM Leaderboard v1 - ARC Challenge34.56Normalized accuracy (%) (25-shot)12.5
Open LLM Leaderboard v1 - MMLU26.31Accuracy (%) (5-shot)12.1
Open LLM Leaderboard v1 - TruthfulQA MC232.92MC2 (%) (0-shot)0.3

Interactive version: theaggregate.ai/model?slug=olmo-1b-hf-bfloat16-rev-e005c9593b71 · How It Works · Data refreshed daily, snapshot 2026-11-08.