OST-Bench - Agent Visible Info: leaderboard
The Agent Visible Info questions of OST-Bench's multi-round version: the model recalls which objects it has seen, how many and where in the exploration. Scores are accuracy (%); the README states 1.4k scenes and 10k question-answer pairs, the per-model sample is not stated.
Metric: Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 10 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 | 76.46 | #505 |
| 2 | InternVL2.5-78B | 74.02 | #1036 |
| 3 | InternVL2.5-38B | 73.88 | #1366 |
| 4 | Gemini 2.0 Flash | 70.82 | #723 |
| 5 | Qwen 2.5 VL 32B Instruct | 64.9 | #1074 |
| 6 | Qwen 2.5 VL 72B Instruct | 64.46 | #849 |
| 7 | LLaVA-Video-72B-Qwen2 | 60.48 | #1344 |
| 8 | InternVL2.5-8B | 58.6 | #2401 |
| 9 | LLaVA-Video-7B-Qwen2 | 58.32 | #1910 |
| 10 | Qwen 2.5 VL 7B Instruct | 52.56 | #1893 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=ost-bench-agent-visible-info · How It Works · Data refreshed daily, snapshot 2026-11-17.