GeoAgentBench (Plan-and-Solve) - Tool Exact Match: leaderboard
Metric: Tools-Exact-Match (%): share of the ground-truth tool sequence matched exactly from the first step, on 53 spatial analysis tasks over 117 atomic GIS tools in an executable sandbox (30 steps per task), agents under the Plan-and-Solve paradigm (a full plan first, then execution without feedback); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash | 60.97 |
| 2 | GPT-4o | 58.18 |
| 3 | DeepSeek V3 | 51.99 |
| 4 | GPT-4o Mini | 46.23 |
| 5 | Claude Sonnet 4.6 | 44.82 |
| 6 | Llama 3.1 8B Instruct | 28.67 |
| 7 | Qwen 2.5 7B Instruct | 21.64 |
Interactive version: theaggregate.ai/benchmark?slug=geoagentbench-plan-and-solve-tool-exact-match · How It Works · Data refreshed daily, snapshot 2026-10-07.