GeoAgentBench (ReAct) - Map Verification: leaderboard

GeoAgentBench (2026) is a dynamic execution benchmark for tool-augmented GIS agents: spatial analysis tasks run in a sandbox of 117 atomic GIS tools and are scored on the tool trajectory, the parameters of the executed calls and the produced map. This board is the 0 to 100 score a GPT-4o judge gives the agent's final map against the gold map for spatial accuracy and cartographic style, with the agent using a ReAct loop with runtime feedback; higher is better.

Metric: VLM verification score (0 to 100, mean of three GPT-4o judgements) comparing the agent's final map with the gold-trajectory map for data-spatial accuracy and cartographic style, on 53 spatial analysis tasks over 117 atomic GIS tools in an executable sandbox (30 steps per task), agents under the ReAct paradigm (thought, action and observation loop with runtime feedback); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.678.1#173
2DeepSeek V365.1#729
3Gemini 2.5 Flash64.3#463
4GPT-4o55.6#751
5GPT-4o Mini36.9#1667
6Qwen 2.5 7B Instruct13.6#2723
7Llama 3.1 8B Instruct7.7#4600

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=geoagentbench-react-map-verification · How It Works · Data refreshed daily, snapshot 2026-11-21.