LinMix - OLMo2 1B 24 Domains - cpile BPB: leaderboard
LinMix compares separately trained, publicly released language models built from scratch with different training-data mixtures. Each result belongs to its exact trained checkpoint; lower bits per byte is better. Bits per byte (lower is better).
Metric: Bits per byte (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | LinMix olmo2-1B-24domains-dirichlet-lightgbm-cpile | 0.84 | |
| 2 | LinMix olmo2-1B-24domains-vertex-linearsqrt-cpile | 0.85 | |
| 3 | LinMix olmo2-1B-24domains-dirichlet-exponential-cpile | 0.86 | |
| 4 | LinMix olmo2-1B-24domains-baseline | 0.89 |
Interactive version: theaggregate.ai/benchmark?slug=linmix-olmo2-1b-24-domains-cpile-bpb · How It Works · Data refreshed daily, snapshot 2026-10-29.