SmolLM-135M-Instruct — benchmark results

Provider: HuggingFace. Released 2024-07-15. Access: Open.

Unified ELO 1110 ± 42, rank #1758 of 1776 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open CoT - LSAT Analytical Reasoning1.74CoT Gain (%)24.8
Open CoT - LogiQA1.44CoT Gain (%)17.2
Open LLM Leaderboard - MuSR3.37Score15.9
Open CoT - LogiQA 21.53CoT Gain (%)15.3
Open LLM Leaderboard - GPQA1.23Score11.8
Open CoT - LSAT Reading Comprehension2.23CoT Gain (%)9.2
Open LLM Leaderboard - MMLU-Pro1.96Score8.8
Open PL LLM - Generative-18.15Average Generative Score (%)7.7
Open CoT Leaderboard1.39Average CoT Gain (%)6.1
Open LLM Leaderboard - MATH Level 50.53Score4.6
Open LLM Leaderboard - BBH2.69Score4.3
Open CoT - LSAT Logical Reasoning0CoT Gain (%)3.8

Interactive version: theaggregate.ai/model?slug=smollm-135m-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.