VideoOdyssey-V - Summarization: leaderboard
Metric: Multiple-choice accuracy (%) on the 65 summarization questions (analyze the visual information to achieve a high-level, abstract understanding) of VideoOdyssey-V (human-written questions on 100 videos of 60 to 255 minutes that need visual cues and long continuous viewing; 1,618 in all), 128 frames for proprietary models and each open model's maximum frame setting; higher is better. Source: arxiv.org. Saturation forecast: Around June 2027. 18 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Kimi K2.5 | 69.2 |
| 2 | Gemini 2.5 Pro | 61.5 |
| 3 | Gemini 3.1 Pro (Preview) | 56.9 |
| 4 | Seed 2.0 Pro | 55.4 |
| 5 | Qwen 3.5 27B | 49.2 |
| 6 | Qwen 3 VL 235B A22B | 47.7 |
| 7 | GPT-5.2 | 44.6 |
| 8 | Phi-4 Multimodal Instruct | 32.3 |
Interactive version: theaggregate.ai/benchmark?slug=videoodyssey-v-summarization · How It Works · Data refreshed daily, snapshot 2026-10-07.