OpenVLM Video - MVBench - Object Existence: leaderboard

MVBench Object Existence accuracy from the OpenCompass OpenVLM Video Leaderboard (VLMEvalKit): one of MVBench's 20 temporal tasks, 200 multiple-choice questions on whether an object is present at a given moment. Accuracy in percent, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 37 models tracked.

Top models

#ModelScoreOverall rank
1InternVL3-38B99.5#413
2InternVL2.5-78B97#434
3InternVL3-8B96.5#624
4InternVL3-78B96.5#361
5InternVL2-8B96#813
6Qwen2.5-Omni-7B95.5#633
7Qwen 2.5 VL 7B91#641
8Qwen 2 VL 72B90.5#450
9Qwen 2 VL 7B88#743
10Gemini 2.0 Flash69#351
11Gemini 1.5 Flash61.5#620
12MiniCPM-V-2.655.5#827
13Claude 3.5 Sonnet54#362
14Phi-4 Multimodal Instruct47.5#922

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openvlm-video-mvbench-object-existence · How It Works · Data refreshed daily, snapshot 2026-11-05.