SmolLM2-360M: benchmark results

Provider: HuggingFace. Released 2024-10-31. Access: Open.

Aggregate Rating 1194 ± 21, rank #1571 of 1640 rated models, from 324 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Dutch Simplification - Duidelijke Taal46.13Score (%)42
EuroEval Spanish Summarization - Mlsum ES23.13chrF3++ (%)40.8
Open LLM Leaderboard - MuSR39.54Score38.5
EuroEval Serbian Summarization - LR SUM SR19.2chrF3++ (%)32
EuroEval Spanish NLU - ScaLA ES1.47Matthews correlation coefficient (%)29.6
EuroEval Romanian Common Sense Reasoning3.43Common Sense Reasoning Average Score (%)29.1
EuroEval Portuguese NLU - ScaLA PT2.79Matthews correlation coefficient (%)28.9
EuroEval Icelandic NLU - ScaLA IS0.37Matthews correlation coefficient (%)28.5
EuroEval Latvian NLU - ScaLA LV1.5Matthews correlation coefficient (%)28.4
EuroEval Albanian Summarization - LR SUM SQ21.5chrF3++ (%)26.8
EuroEval Catalan Summarization - Dacsa CA28.66chrF3++ (%)26
EuroEval English NLU - SQuAD61.31Character F1 (%)25.2

Interactive version: theaggregate.ai/model?slug=smollm2-360m · How It Works · Data refreshed daily, snapshot 2026-10-16.