ERGeoBench - Embodied GLS: leaderboard
Embodied geo-localization on ERGeoBench (2026): a model locates a real-world street scene as an embodied agent that turns, tilts and zooms to gather views, scored by the Geo-localization Score, the mean of hierarchical street, city and country accuracy, distance-threshold hit rates and a log-scaled median error. Scale 0 to 100; higher is better.
Metric: Geo-localization Score, GLS (0-100): mean of the street, city and country accuracy, the hit rate within 1, 25, 200, 750 and 2,500 km, and a log-scaled median-error score, over the 2,207 street-level panoramas, located as an embodied agent that chooses yaw, pitch and zoom actions to gather sequential egocentric views; unified structured prompt with egocentric observations, action history and in-context examples, temperature 0.1, first valid JSON object parsed (invalid outputs count as failures); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 69.02 | #276 |
| 2 | Gemini 3 Flash | 68.81 | #175 |
| 3 | GPT-4o | 67.55 | #751 |
| 4 | Gemini 2.0 Flash | 67.13 | #723 |
| 5 | InternVL3-8B | 43.91 | #1782 |
| 6 | Qwen 3 VL 8B | 43.87 | #917 |
| 7 | Qwen-VL-Max | 42.54 | #1400 |
| 8 | InternVL2.5-8B | 33.46 | #2370 |
| 9 | Qwen 2.5 VL 7B | 33.38 | #1862 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=ergeobench-embodied-gls · How It Works · Data refreshed daily, snapshot 2026-11-21.