SmolLM3-3B: benchmark results
Hugging Face's fully open Apache-2.0 3B model (July 2025) with dual think/no-think reasoning modes, 128K context, and a published training recipe and data mix. Provider: HuggingFace. Released 2025-07-08. Access: Open.
Aggregate Rating 1392 ± 13, rank #1252 of 1656 rated models, from 408 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| RoBench-25 (Awareness Instruction) - No Trigger | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger A | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger B | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger C | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger D | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger E | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger F | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness Instruction) - Trigger G | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness and Recovery Instructions) - No Trigger | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness and Recovery Instructions) - Trigger A | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness and Recovery Instructions) - Trigger B | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
| RoBench-25 (Awareness and Recovery Instructions) - Trigger D | 1 | Clipped Heidke skill score (0-1; chance-corrected accuracy o | 100 |
Interactive version: theaggregate.ai/model?slug=smollm3-3b · How It Works · Data refreshed daily, snapshot 2026-10-20.