RVMS-Bench (RACLO) - Moment Localization (Key Moment, Temporal, Audio): leaderboard

Metric: Moment localization accuracy (%) on the 160 queries giving the key moment, temporal context and auditory memory: the frame the model predicts for the remembered moment is certified as matching the gold frame by a Gemini 2.5 Pro verifier; closed models see 32 to 192 frames by video length, open models 64; RVMS-Bench's real-world YouTube video search queries built from fuzzy memory cues (global impression G, key moment K, temporal context T, auditory memory A; 160 queries per cue combination, 20 topics, four duration bands), each model run as the backbone of the RACLO open-web search agent (two search queries, two candidate URLs each); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.241.9#105
2Gemini 3 Pro34.4#77
3GPT-4o19.4#333
4GPT-5 Mini11.9#176
5Gemini 2.5 Pro8.1#145
6Qwen 2.5 VL 72B Instruct5#364
7Qwen 3 VL 235B A22B Instruct2.5#264

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=rvms-bench-raclo-moment-localization-key-moment-temporal-audio · How It Works · Data refreshed daily, snapshot 2026-10-11.