SmolVLM2-2.2B-Instruct: benchmark results

Provider: HuggingFace. Released 2025-02-20. Access: Open.

Aggregate Rating 1347 ± 36, rank #7791 of 10916 rated models, from 113 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenVLM Video - Video-MME (w/o subs) - Short Videos79Accuracy (%)86.1
ProactiveBench - ChangeIt25.5Trajectory accuracy (%) on the ambiguous ChangeIt video fram66.7
ProactiveBench - MVP-N11.1Trajectory accuracy (%) on the uninformative multi-view obje66.7
OpenVLM Video - MMBench-Video - Coarse Perception1.7GPT-4 Rating (0-3)55.7
OpenVLM Video - MMBench-Video - Relation Reasoning1.48GPT-4 Rating (0-3)53.4
OpenVLM Video - MMBench-Video - Temporal Reasoning1.24GPT-4 Rating (0-3)51.1
OpenVLM Video - MMBench-Video - Commonsense Reasoning1.46GPT-4 Rating (0-3)50
OpenVLM Video - MMBench-Video - Single-Instance Fine-grained Perception1.5GPT-4 Rating (0-3)50
OpenVLM Video - MVBench - Object Interaction70Accuracy (%)50
ProactiveBench - VSOD11.9Trajectory accuracy (%) on the temporally occluded video fra47.6
OpenVLM Video - MVBench - Scene Transition89Accuracy (%)47.2
OpenVLM Video - MMBench-Video - Cross-Instance Fine-grained Perception1.18GPT-4 Rating (0-3)46.6

Interactive version: theaggregate.ai/model?slug=smolvlm2-2-2b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.