Molmo2-VideoCount: leaderboard

Metric: Exact-count accuracy (%; 533 validation queries). Source: arxiv.org. Saturation forecast: Around 2034. 21 models tracked.

Top models

#ModelScore
1Gemini 3 Pro37.1
2Gemini 2.5 Pro35.8
3GPT-535.8
4Molmo2-8B35.5
5Gemini 2.5 Flash31.9
6GPT-5 Mini29.8
7Qwen 3 VL 8B29.6
8Claude Sonnet 4.527.2
9GLM-4.1V-9B (Thinking)26.6
10Qwen 3 VL 4B25.3

Interactive version: theaggregate.ai/benchmark?slug=molmo2-videocount · How It Works · Data refreshed daily, snapshot 2026-09-25.