VideoMME w/o sub.: leaderboard
Frames-only setting of Video-MME (2024): 2,700 four-option questions on 900 videos of 11 s to 1 h, 300 each of short, medium (4 to 15 min) and long (30 to 60 min); Gemini 1.5 Pro 75%, GPT-4o 71.9%.
Metric: Score (imported). Source: arxiv.org. Source: benchmarklist.com. 51 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | video-SALMONN 2+ | 79.7 | |
| 2 | Gemini 1.5 Pro | 75 | #445 |
| 3 | AdaReTaKe | 73.5 | |
| 4 | TSPO | 73 | |
| 5 | Keye-VL-1.5 | 73 | |
| 6 | InternVL2.5 | 72.1 | |
| 7 | GPT-4o | 71.9 | #343 |
| 8 | Qwen2-VL | 71.2 | |
| 9 | LLaVA-Video | 70.6 | |
| 10 | JT-VL-Chat | 70.6 |
Interactive version: theaggregate.ai/benchmark?slug=videomme-w-o-sub · How It Works · Data refreshed daily, snapshot 2026-10-20.