ERGeoBench - Embodied GLS: leaderboard

Metric: Geo-localization Score, GLS (0-100): mean of the street, city and country accuracy, the hit rate within 1, 25, 200, 750 and 2,500 km, and a log-scaled median-error score, over the 2,207 street-level panoramas, located as an embodied agent that chooses yaw, pitch and zoom actions to gather sequential egocentric views; unified structured prompt with egocentric observations, action history and in-context examples, temperature 0.1, first valid JSON object parsed (invalid outputs count as failures); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 9 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro69.02
2Gemini 3 Flash68.81
3GPT-4o67.55
4Gemini 2.0 Flash67.13
5InternVL3-8B43.91
6Qwen 2.5 VL 7B33.38

Interactive version: theaggregate.ai/benchmark?slug=ergeobench-embodied-gls · How It Works · Data refreshed daily, snapshot 2026-10-07.