OLMo-1B-hf: benchmark results

Provider: Allen AI. Released 2024-04-12. Access: Open.

Aggregate Rating 1163 ± 51, rank #9809 of 10916 rated models, from 34 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AI Energy Score (Text Generation)5Energy Score (1-5)79.5
Open LLM Leaderboard - MuSR40.98Score50.2
Open PL LLM - PSC (generative, 5-shot)76.04Binary F1 (%)26.5
Open PL LLM - KLEJ NER (generative, 5-shot)29.45Accuracy (%)16
Open LLM Leaderboard - GPQA26.17Score15.6
Open LLM Leaderboard - IFEval21.82Score14.5
Open PL LLM - Generative1.26Average Generative Score (%)12.6
Open LLM Leaderboard - MATH Level 51.74Score12.4
Open PL LLM - PolQA Reranking (multiple choice, 5-shot)52.6Accuracy (%)12.3
Open PL LLM - RAG5.55Average RAG Score (%)11.5
Open PL LLM - PPC (generative, 5-shot)34.4Accuracy (%)11.3
Open PL LLM - PolEmo2-OUT (generative, 5-shot)32.19Accuracy (%)10.7

Interactive version: theaggregate.ai/model?slug=olmo-1b-hf · How It Works · Data refreshed daily, snapshot 2026-11-08.