Video-MME-v2 - Level 3 Complex Reasoning (w/o subs): leaderboard

Video-MME-v2 group score without subtitles on level 3, complex reasoning across time. Video-MME-v2 groups four interrelated questions and scores each group non-linearly, so credit depends on consistency and a complete reasoning chain, not only per-question accuracy. 0-100, higher is better; same run per model as the headline board.

Metric: Level 3 Score w/o sub (%). Source: video-mme-v2.netlify.app. Saturation forecast: Around March 2028. 49 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro30.15#82
2Doubao-Seed-2.0-Pro-26021526.21#86
3Gemini 3 Flash24.95#103
4Kimi K2.524.8#152
5GPT-521.33#105
6Gemma 4 31B15.98#212
7Qwen 3.5 Omni Plus14.53#111
8Qwen 3 VL 235B A22B (Thinking)14.49#236
9Qwen 3 VL 235B A22B Instruct13.89#280
10Qwen 2.5 VL 72B Instruct12.61#383
11Qwen 3 VL 8B (Thinking)11.11#423
12Qwen 3 VL 8B Instruct10.72#419
13Qwen 3 VL 4B Instruct10.26#510
14Qwen 3 VL 30B A3B (Thinking)10.02#348
15Qwen 3 VL 4B (Thinking)9.76#548

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=video-mme-v2-level-3-complex-reasoning-w-o-subs · How It Works · Data refreshed daily, snapshot 2026-11-05.