SLVMBench (Immediate Application): leaderboard

Metric: Accuracy (%) on 2,261 five-option questions on 1,220 videos in 11 categories, asked at a cutoff in a target video after a tutorial, with the tutorial followed immediately by the target video; each model at its own frame sampling. Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)74.92
2GPT-5.257.94
3GPT-4o (2024-05-13)52.83
4Qwen2.5-Omni-7B41.63

Interactive version: theaggregate.ai/benchmark?slug=slvmbench-immediate-application · How It Works · Data refreshed daily, snapshot 2026-09-29.