GeoAgentBench (Base Agent): leaderboard
GeoAgentBench (2026) is a dynamic execution benchmark for tool-augmented GIS agents: spatial analysis tasks run in a sandbox of 117 atomic GIS tools and are scored on the tool trajectory, the parameters of the executed calls and the produced map. This board is parameter execution accuracy in percent, the share of gold steps whose final matching call has equivalent parameters, with the agent using zero-shot tool scheduling without execution feedback; higher is better.
Metric: Parameter Execution Accuracy (%): share of ground-truth steps whose last matching tool call has semantically equivalent parameters, on 53 spatial analysis tasks over 117 atomic GIS tools in an executable sandbox (30 steps per task), agents under the base agent paradigm (zero-shot tool scheduling without execution feedback); higher is better. Source: arxiv.org. Saturation forecast: Around June 2027. 7 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Flash | 43.02 | #463 |
| 2 | DeepSeek V3 | 40.41 | #729 |
| 3 | Claude Sonnet 4.6 | 39.84 | #173 |
| 4 | GPT-4o Mini | 35.39 | #1667 |
| 5 | GPT-4o | 32.54 | #751 |
| 6 | Llama 3.1 8B Instruct | 24.83 | #4600 |
| 7 | Qwen 2.5 7B Instruct | 12.42 | #2723 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=geoagentbench-base-agent · How It Works · Data refreshed daily, snapshot 2026-11-21.