SmolLM2-135M-Instruct: benchmark results

Provider: HuggingFace. Released 2024-10-31. Access: Open.

Aggregate Rating 1174 ± 23, rank #9750 of 10916 rated models, from 322 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Albanian Common Sense Reasoning1.99Common Sense Reasoning Average Score (%)36.8
EuroEval Spanish Summarization - Mlsum ES22.56chrF3++ (%)35.4
Open LLM Leaderboard - MuSR38.71Score33.4
EuroEval Serbian Summarization - LR SUM SR19.45chrF3++ (%)32.7
EuroEval Norwegian Knowledge - Idioms NO0.68MCC (x100)32.4
EuroEval Albanian NLU - ScaLA SQ0.92Matthews correlation coefficient (%)29.5
Open LLM Leaderboard - IFEval28.83Score26
EuroEval Icelandic NLU - ScaLA IS0.16Matthews correlation coefficient (%)25.8
EuroEval Ukrainian Common Sense Reasoning1.7Common Sense Reasoning Average Score (%)24.5
EuroEval Icelandic Knowledge1.68Knowledge Average Score (%)24.4
EuroEval Latvian NLU - ScaLA LV0.71Matthews correlation coefficient (%)24.1
EuroEval Icelandic Common Sense Reasoning1.08Common Sense Reasoning Average Score (%)23.8

Interactive version: theaggregate.ai/model?slug=smollm2-135m-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.