LinMix - OLMo2 1B 288 Domains - hellaswag BPB: leaderboard

LinMix compares separately trained, publicly released language models built from scratch with different training-data mixtures. Each result belongs to its exact trained checkpoint; lower bits per byte is better. Bits per byte (lower is better).

Metric: Bits per byte (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 9 models tracked.

Top models

#ModelScoreOverall rank
1LinMix olmo2-1B-288domains-vertex-linear-hellaswag0.76
2LinMix olmo2-1B-288domains-vertex-linearsqrt-hellaswag0.76
3LinMix olmo2-1B-288domains-vertex-linearscaled-hellaswag0.76
4LinMix olmo2-1B-288domains-vertex-linearlog-hellaswag0.76
5LinMix olmo2-1B-288domains-dirichlet-linearscaled-hellaswag0.76
6LinMix olmo2-1B-288domains-dirichlet-linear-hellaswag0.76
7LinMix olmo2-1B-288domains-dirichlet-exponential-hellaswag0.78
8LinMix olmo2-1B-288domains-dirichlet-lightgbm-hellaswag0.78
9LinMix olmo2-1B-288domains-baseline0.79

Interactive version: theaggregate.ai/benchmark?slug=linmix-olmo2-1b-288-domains-hellaswag-bpb · How It Works · Data refreshed daily, snapshot 2026-10-29.