OpenVLM Video - Video-MME (w/o subs) - Counting Problem: leaderboard

Metric: Accuracy (%). Source: huggingface.co. 37 models tracked.

Top models

#ModelScore
1Gemini 2.0 Flash48.9
2InternVL3-78B48.5
3InternVL2.5-78B48.5
4GPT-4o (2024-08-06)47.4
5InternVL3-8B44
6Qwen 2 VL 72B41.4
7Gemini 1.5 Flash38.1
8InternVL2-8B35.8
9Claude 3.5 Sonnet35.4
10Qwen 2 VL 7B34.7
11Phi-4 Multimodal Instruct28

Interactive version: theaggregate.ai/benchmark?slug=openvlm-video-video-mme-w-o-subs-counting-problem · How It Works · Data refreshed daily, snapshot 2026-09-19.