Video-MME - Long Videos (w/ subs): leaderboard

Video-MME accuracy on long videos (30 to 60 minutes), with subtitles: four-option multiple-choice questions over videos from six visual domains, from the official leaderboard table. Accuracy in percent, higher is better.

Metric: Accuracy (%). Source: video-mme.github.io. Saturation forecast: Estimated already saturated. 51 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 1.5 Pro77.4#454
2GPT-4o72.1#357
3Gemini 1.5 Flash68.8#620
4GPT-4o Mini63.4#598
5MiniCPM-V-2.656.3#827
6Claude 3.5 Sonnet54.7#362
7Qwen-VL-Max47#475

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=video-mme-long-videos-w-subs · How It Works · Data refreshed daily, snapshot 2026-11-05.