VANTAGE-Bench - Video QA: leaderboard

VANTAGE-Bench vision-language video-understanding leaderboard — video question-answering accuracy.

Metric: Video QA (%). Source: huggingface.co. Saturation forecast: Around January 2027. 18 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6 Astra83.26#6
2GPT-5.6 Sol78.08#19
3Gemini 3.6 Flash76.82#51
4Qwen 3.5 9B71.63#379
5Gemini 3.1 Pro (Preview)71.46#58
6Qwen 3 VL 32B Instruct71.3#283
7Gemini 3.1 Flash Lite68.03#191
8Qwen 3.5 27B67.95#187
9Qwen 3 VL 8B Instruct66.44#420
10Gemini 3.5 Flash Lite65.61#156
11Gemma 4 E2B (IT)46.19#781

No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #8 Gemini 4 Argon.

Interactive version: theaggregate.ai/benchmark?slug=vantage-bench-video-qa · How It Works · Data refreshed daily, snapshot 2026-10-20.