TraceAV-Bench - Spatiotemporal Localization: leaderboard

Metric: Accuracy (%) on the 227 Spatiotemporal Localization (SL) questions, four-option multiple choice over long audio-visual videos (10 to 140 minutes), exact match of the selected option set, each model at its official inference setting, with the full audio and video input; higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 15 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)51.54
2Gemini 2.5 Pro48.02
3Qwen2.5-Omni-7B37.44
4Gemini 2.5 Flash29.07
5Gemini 3 Flash29.07
6Gemini 2.0 Flash25.11
7Gemma 4 E4B16.74

Interactive version: theaggregate.ai/benchmark?slug=traceav-bench-spatiotemporal-localization · How It Works · Data refreshed daily, snapshot 2026-10-07.