SceneBench - Comment Prediction: leaderboard

Metric: Accuracy (%) on SceneBench's 297 comment prediction items (choosing the viewer comment that belongs to the video), SceneBench (2,485 long videos averaging 33 minutes), four-option multiple choice, each model at its own recommended frame budget; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 19 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro92.9#145
2Kimi K2.590.9#139
3Qwen 2.5 VL 7B Instruct78.6#643
4Gemini 2.5 Flash Lite78.2#413

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=scenebench-comment-prediction · How It Works · Data refreshed daily, snapshot 2026-10-11.