Axis Spatial v2 - GeoBenchX: leaderboard
Spatial Agent Index v2, separate from methodology1.0 observations. One attempt per task, 60turns and7200seconds; native reasoning/harness defaults, output cap65536except native ClaudeCode/Codex. Provider calls retry up to9times; persistent failed trajectories rerun, at most1%after3reruns omitted. Refusals score0. A timeout with over half time waiting on provider reruns. Unattempted/unjudged maps omitted; passing attempts awaiting trace review count as passes. Trace failure is limited to obtaining answer/check content or external answers. Claude Sonnet5.5 high judges maps and traces, including its own family. Nominal Vision pool128built minus47excluded=81; source history adds22ThinkGeo tasks, while an older106-42=64paragraph is stale. Native per-entry scored denominators remain unreported. Same-model/effort Stirrup Vision results may supply Terminus2 entries. At least75%view completion qualifies a source index entry; default charts select model families and do not define our retained roster. Metric: Pass@1 (%). Source: https://www.axisspatial.com/arena/agent-index
Metric: Pass@1 (%). Source: www.axisspatial.com. Saturation forecast: Rough model projection: around 2026. 50 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Opus 5.5 | (Max) (Axis Spatial run: native=claude-code-claude-opus-5-5-max, cfg=06d59074e2e49c42) | 83.67 | #7 |
| 2 | Claude Fable 5.1 | (Medium) (Axis Spatial run: native=claude-code-claude-fable-5-1-medium, cfg=d02f729401d534f3) | 81.33 | #17 |
| 3 | Claude Sonnet 5.5 | (High) (Axis Spatial run: native=claude-code-claude-sonnet-5-5-high, cfg=bf92f603d195d150) | 81.33 | #21 |
| 4 | GPT-6.1 Sol | (xHigh) (Axis Spatial run: native=codex-gpt-6-1-sol-xhigh, cfg=006589addbd990d4) | 79.33 | #12 |
| 5 | Claude Haiku 5.5 | (Max) (Axis Spatial run: native=claude-code-claude-haiku-5-5-max, cfg=5ca9034a64cb2ec2) | 78 | #76 |
| 6 | Claude Sonnet 5 | (High) (Axis Spatial run: native=claude-code-claude-sonnet-5-high, cfg=2270168c0d10402d) | 77.33 | #118 |
| 7 | Gemini 3.8 Flash | (Low) (Axis Spatial run: native=gemini-3-8-flash-low, cfg=8d9091d19a9cfcc1) | 76 | #39 |
| 8 | GPT-6 Sol | (Medium) (Axis Spatial run: native=codex-gpt-6-sol-medium, cfg=9cfd2a064105bb74) | 75 | #29 |
| 9 | Claude Opus 5 | (High) (Axis Spatial run: native=claude-code-claude-opus-5-high, cfg=6285e6a048aeccf0) | 74.67 | #23 |
| 10 | GPT-6 Luna | (High) (Axis Spatial run: native=codex-gpt-6-luna-high, cfg=844ad78a5b6cd008) | 74 | #105 |
| 11 | Gemini 3.1 Pro (Preview) | (Low) (Axis Spatial run: native=gemini-3-1-pro-preview-low, cfg=96fc81922ecbd1db) | 74 | #99 |
| 12 | Claude Opus 4.8 | (High) (Axis Spatial run: native=claude-code-claude-opus-4-8-high, cfg=5dcc0d54f0927527) | 73.33 | #62 |
| 13 | Claude Opus 4.7 | (High) (Axis Spatial run: native=claude-code-claude-opus-4-7-high, cfg=d1b9c219cbc0f072) | 72.67 | #82 |
| 14 | DeepSeek V4 Pro | (High) (Axis Spatial run: native=codex-deepseek-v4-pro-high, cfg=21c081d31d0b1e76) | 71.59 | #198 |
| 15 | GLM-5.3 Flash | (Max) (Axis Spatial run: native=claude-code-glm-5-3-flash-max, cfg=51278108e969227a) | 70.83 | #136 |
Interactive version: theaggregate.ai/benchmark?slug=axis-spatial-v2-geobenchx · How It Works · Data refreshed daily, snapshot 2026-11-17.