OST-Bench - Agent State: leaderboard
The Agent State questions of OST-Bench's multi-round version: the model tracks its own position and orientation as it explores a scene frame by frame. Scores are accuracy (%); the README states 1.4k scenes and 10k question-answer pairs, the per-model sample is not stated.
Metric: Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 10 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 | 47.23 | #505 |
| 2 | InternVL2.5-78B | 46.45 | #1036 |
| 3 | InternVL2.5-38B | 45.38 | #1366 |
| 4 | Gemini 2.0 Flash | 45.05 | #723 |
| 5 | Qwen 2.5 VL 32B Instruct | 43.75 | #1074 |
| 6 | Qwen 2.5 VL 72B Instruct | 43.48 | #849 |
| 7 | InternVL2.5-8B | 41.87 | #2401 |
| 8 | Qwen 2.5 VL 7B Instruct | 40.43 | #1893 |
| 9 | LLaVA-Video-72B-Qwen2 | 39.95 | #1344 |
| 10 | LLaVA-Video-7B-Qwen2 | 33.5 | #1910 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=ost-bench-agent-state · How It Works · Data refreshed daily, snapshot 2026-11-17.