SmolLM2-135M: benchmark results

Provider: HuggingFace. Released 2024-10-31. Access: Open.

Aggregate Rating 1160 ± 26, rank #9833 of 10916 rated models, from 288 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MuSR41.12Score51.4
Fibble3 Arena (8 guesses)0Daily clean-run win rate (%), 8 guesses50
Fibble4 Arena (8 guesses)0Daily clean-run win rate (%), 8 guesses46.4
Fibble2 Arena (8 guesses)0Daily clean-run win rate (%), 8 guesses43.8
EuroEval Norwegian Knowledge - Idioms NO1.78MCC (x100)42.5
Fibble2 Arena0Daily clean-run win rate (%), 10 guesses40
Fibble4 Arena0Daily clean-run win rate (%), 12 guesses38.9
Fibble3 Arena0Daily clean-run win rate (%), 12 guesses36.8
Fibble5 Arena0Daily clean-run win rate (%), 9 guesses35.9
EuroEval Catalan NLU - ScaLA CA0.01Matthews correlation coefficient (%)34.6
EuroEval Icelandic NLU - ScaLA IS0.87Matthews correlation coefficient (%)34.3
Fibble5 Arena (8 guesses)0Daily clean-run win rate (%), 8 guesses33.3

Interactive version: theaggregate.ai/model?slug=smollm2-135m · How It Works · Data refreshed daily, snapshot 2026-11-08.