Open SLM Leaderboard - ARC-Easy: leaderboard
The Open SLM Leaderboard (Axiomic Labs, Hugging Face Space) ranks open-weight language models under 400M parameters that their submitters pretrained from scratch, with zero-shot scores from LM-eval harness and Axiomic Labs' ArithMark-3 script that the leaderboard team checks before merging. Unlike the Hugging Face Open LLM Leaderboard, which evaluated every submitted model on its own cluster, it lists zero-shot results the submitters ran and admits only small from-scratch checkpoints (no merges). The page does not state the harness version, the accuracy variant (acc or acc_norm) or the evaluated splits. Rows are bound to their Hugging Face model card; a row without one (Mystery-5M-Preview) is withheld, and a row missing a score is absent from that board only. ARC-Easy grade-school science multiple choice, zero-shot accuracy (%, chance 25).
Metric: Zero-shot accuracy (%, chance 25). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 264 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | LFM-2.5-350M-Base (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=LiquidAI/LFM2.5-350M-Base) | 68.86 | |
| 2 | SmolLM2-360M (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=HuggingFaceTB/SmolLM2-360M) | 68.48 | |
| 3 | BananaMind-2.5-Pro (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=BananaMind/BananaMind-2.5-Pro) | 62.79 | |
| 4 | MobileLLM-R1-360M-base (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=facebook/MobileLLM-R1-360M-base) | 61.32 | |
| 5 | KLM-1.6 (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=MinimaLabs/KLM-1.6) | 61.07 | |
| 6 | LFM-2.5-230M-Base (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=LiquidAI/LFM2.5-230M-Base) | 59.72 | |
| 7 | KLM-1.5 (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=MinimaLabs/KLM-1.5) | 59.68 | |
| 8 | GPT-X3-150M (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=AxiomicLabs/GPT-X3-150M) | 59.64 | |
| 9 | Boris-2-Preview-2 (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=opencerebral/Boris-2-Preview-2) | 59.13 | |
| 10 | SmolLM2-135M (Benchmark Sweep Run: source=Open SLM Leaderboard; zero-shot; card=HuggingFaceTB/SmolLM2-135M) | 58.63 |
Interactive version: theaggregate.ai/benchmark?slug=open-slm-leaderboard-arc-easy · How It Works · Data refreshed daily, snapshot 2026-11-12.