360CityArena - Localization: leaderboard

360CityArena (2026) places a multimodal agent in a navigable reconstruction of the Akihabara district of Tokyo built from 360-degree street video, where it explores with discrete view and movement actions while a map marks its position. In this task the agent must work out where it started on a 5 by 5 grid of the district; exact-match accuracy over 25 tasks, in percent; higher is better.

Metric: Exact-match accuracy (%; the agent infers its starting cell on a 5 x 5 grid of the district from what it observes; 25 human-authored tasks in a navigable reconstruction of the Akihabara district from 602 360-degree video segments; the agent acts with seven discrete view and movement actions and sees a map marking its position and heading; one run). Source: arxiv.org. Saturation forecast: Around 2029. 6 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash12#453
2GPT-58#167
3Claude Sonnet 4.54#250
4Qwen 2.5 VL 32B Instruct4#1053

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=360cityarena-localization · How It Works · Data refreshed daily, snapshot 2026-11-13.