SmolLM-1.7B: benchmark results

Provider: HuggingFace. Released 2024-07-14. Access: Open.

Unified ELO 1297 ± 1, rank #1503 of 1553 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AI Energy Score (Text Generation)4Energy Score (1-5)47.5
Open LLM Leaderboard - IFEval23.62Score17.3
Open PL LLM - RAG7.53Average RAG Score (%)12.2
Open LLM Leaderboard - MATH Level 51.66Score12.1
Open PL LLM Leaderboard-5.33Average Score (%)11.9
Open PL LLM - Multiple Choice-12.45Average Multiple-Choice Score (%)10.5
Open PL LLM - Generative0.16Average Generative Score (%)10.1
Open LLM Leaderboard - MuSR2.13Score9.4
Open LLM Leaderboard - BBH4.41Score8.7
Open LLM Leaderboard - MMLU-Pro1.64Score6.6
Open LLM Leaderboard - GPQA0Score2.6

Interactive version: theaggregate.ai/model?slug=smollm-1-7b · How It Works · Data refreshed daily, snapshot 2026-09-08.