OpenVLM Video - Video-MME (w/o subs) - Attribute Perception: leaderboard

Video-MME Attribute Perception accuracy without subtitles, from the OpenCompass OpenVLM Video Leaderboard (VLMEvalKit): the four-option multiple-choice questions of this task type, pooled over short, medium and long videos. One of 12 Video-MME task types; accuracy in percent, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 37 models tracked.

Top models

#ModelScoreOverall rank
1InternVL2.5-78B85.6#434
2Gemini 2.0 Flash85.1#351
3InternVL3-78B85.1#361
4InternVL3-38B83.3#413
5Qwen 2 VL 72B80.6#450
6InternVL3-8B77.9#624
7MiniCPM-V-2.676.1#827
8Qwen 2.5 VL 7B74.8#641
9Qwen2.5-Omni-7B74.8#633
10Qwen 2 VL 7B73.4#743
11Gemini 1.5 Flash69.8#620
12InternVL2-8B65.8#813
13Claude 3.5 Sonnet58.1#362
14Phi-4 Multimodal Instruct50.5#922

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openvlm-video-video-mme-w-o-subs-attribute-perception · How It Works · Data refreshed daily, snapshot 2026-11-05.