LinMix - Qwen3.5-like 1B 40 Domains cpile Target - cpile BPB: leaderboard

LinMix compares separately trained, publicly released language models built from scratch with different training-data mixtures. Each result belongs to its exact trained checkpoint; lower bits per byte is better. Bits per byte (lower is better).

Metric: Bits per byte (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.

Top models

#ModelScoreOverall rank
1LinMix qwen3.5-1B-40domains-vertex-linear-cpile0.8
2LinMix qwen3.5-1B-40domains-dirichlet-exponential-cpile0.8
3LinMix qwen3.5-1B-40domains-dirichlet-lightgbm-cpile0.81
4LinMix qwen3.5-1B-40domains-baseline0.81

Interactive version: theaggregate.ai/benchmark?slug=linmix-qwen3-5-like-1b-40-domains-cpile-target-cpile-bpb · How It Works · Data refreshed daily, snapshot 2026-10-29.