LLM Stats (Video-MME): leaderboard

900 videos spanning 6 domains with 2,700 QA pairs testing short/medium/long video understanding with optional subtitles.

Metric: Score (%). Source: llm-stats.com. Saturation forecast: Estimated already saturated. 17 models tracked.

Top models

#ModelScoreOverall rank
1Seed 2.1 Pro89.2#67
2Seed 2.1 Turbo89#86
3Qwen 3.7 Plus88#92
4MiMo-V2.587.7#196
5Kimi K2.587.4#144
6MiniMax-M385.4#136
7Gemini 2.5 Pro84.8#152
8Qwen 3.6 Plus84.2#120
9Gemini 1.5 Pro78.6#445
10Gemini 1.5 Flash76.1#618
11Qwen 3 VL 30B A3B Instruct74.5#384
12Qwen 3 VL 30B A3B (Thinking)73.3#351 (Qwen 3 VL 30B A3B)
13Qwen 3 VL 8B (Thinking)71.8
14Qwen 3 VL 8B Instruct71.4#420
15Gemini 1.5 Flash-8B66.2#819

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=llm-stats-video-mme · How It Works · Data refreshed daily, snapshot 2026-10-20.