SceneBench - Inverse VQA: leaderboard

Metric: Accuracy (%) on SceneBench's 485 inverse vqa items (choosing which of four questions a given answer belongs to, using the whole video), SceneBench (2,485 long videos averaging 33 minutes), four-option multiple choice, each model at its own recommended frame budget; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 19 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro82.4#145
2Kimi K2.560.7#139
3Gemini 2.5 Flash Lite41.6#413
4Qwen 2.5 VL 7B Instruct38.8#643

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=scenebench-inverse-vqa · How It Works · Data refreshed daily, snapshot 2026-10-11.