OVO-S-Bench - Context Tracking: leaderboard
Metric: Level 2 (spatiotemporal context tracking of evidence no longer in view) multiple-choice accuracy (%) on the 1,680-question evaluation set, prefix-access mode (128 frames sampled uniformly from the video before the query timestamp, question given with the frames), mean of its three task families. Source: arxiv.org. Saturation forecast: Around 2030. 31 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 64.04 |
| 2 | GPT-5.4 | 57.59 |
| 3 | Qwen 3.5 397B A17B | 55.39 |
| 4 | Qwen 3 VL 235B A22B | 55.18 |
| 5 | Qwen 3.5 27B (Non-reasoning) | 55.15 |
| 6 | Gemini 3.1 Flash Lite | 52.19 |
| 7 | Qwen 3 VL 32B Instruct | 51.91 |
| 8 | Qwen 3.5 9B (Non-reasoning) | 49.37 |
| 9 | Qwen 3.5 4B (Non-reasoning) | 48.2 |
| 10 | Qwen 3 VL 4B Instruct | 48.18 |
| 11 | Grok 4.1 Fast (Non-reasoning) | 46.59 |
| 12 | Gemma 4 26B A4B | 46.55 |
| 13 | InternVL3.5-8B | 45.83 |
| 14 | Qwen 2.5 VL 7B Instruct | 45.51 |
| 15 | Gemma 4 E4B | 42.76 |
Interactive version: theaggregate.ai/benchmark?slug=ovo-s-bench-context-tracking · How It Works · Data refreshed daily, snapshot 2026-09-29.