SmolVLM-500M: benchmark results

Provider: HuggingFace. Released 2025-01-23. Access: Open.

Aggregate Rating 1238 ± 29, rank #9356 of 10916 rated models, from 499 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenVLM MMT-Bench - 3D Indoor Recognition60Score (%)99.5
OpenVLM MMMU - Music46.7Accuracy (%)96.8
OpenVLM MMT-Bench - GUI Install60Score (%)94.9
OpenVLM MMT-Bench - Action Quality Assessment35Score (%)94.2
OpenVLM MMT-Bench - Color Constancy71.4Score (%)94.2
OpenVLM MMT-Bench - 3D55Score (%)90.8
OpenVLM MMT-Bench - Image Matting30Score (%)90.3
OpenVLM MMT-Bench - Sketch-to-Code40Score (%)85.7
OpenVLM MMT-Bench - Multiple View Image Understanding35Score (%)82.3
OpenVLM MMT-Bench - Animal Keypoint Detection40Score (%)82
OpenVLM MMT-Bench - Spot The Diff65Score (%)77.9
OpenVLM MMT-Bench - Raven Progressive Matrices20Score (%)76.2

Interactive version: theaggregate.ai/model?slug=smolvlm-500m · How It Works · Data refreshed daily, snapshot 2026-11-08.