Axis Spatial v2 - GeoBenchX: leaderboard

Spatial Agent Index v2, separate from methodology1.0 observations. One attempt per task, 60turns and7200seconds; native reasoning/harness defaults, output cap65536except native ClaudeCode/Codex. Provider calls retry up to9times; persistent failed trajectories rerun, at most1%after3reruns omitted. Refusals score0. A timeout with over half time waiting on provider reruns. Unattempted/unjudged maps omitted; passing attempts awaiting trace review count as passes. Trace failure is limited to obtaining answer/check content or external answers. Claude Sonnet5.5 high judges maps and traces, including its own family. Nominal Vision pool128built minus47excluded=81; source history adds22ThinkGeo tasks, while an older106-42=64paragraph is stale. Native per-entry scored denominators remain unreported. Same-model/effort Stirrup Vision results may supply Terminus2 entries. At least75%view completion qualifies a source index entry; default charts select model families and do not define our retained roster. Metric: Pass@1 (%). Source: https://www.axisspatial.com/arena/agent-index

Metric: Pass@1 (%). Source: www.axisspatial.com. Saturation forecast: Rough model projection: around 2026. 50 models tracked. Updated 17 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 5.5(Max) (Axis Spatial run: native=claude-code-claude-opus-5-5-max, cfg=06d59074e2e49c42)83.67#7
2Claude Fable 5.1(Medium) (Axis Spatial run: native=claude-code-claude-fable-5-1-medium, cfg=d02f729401d534f3)81.33#17
3Claude Sonnet 5.5(High) (Axis Spatial run: native=claude-code-claude-sonnet-5-5-high, cfg=bf92f603d195d150)81.33#21
4GPT-6.1 Sol(xHigh) (Axis Spatial run: native=codex-gpt-6-1-sol-xhigh, cfg=006589addbd990d4)79.33#12
5Claude Haiku 5.5(Max) (Axis Spatial run: native=claude-code-claude-haiku-5-5-max, cfg=5ca9034a64cb2ec2)78#76
6Claude Sonnet 5(High) (Axis Spatial run: native=claude-code-claude-sonnet-5-high, cfg=2270168c0d10402d)77.33#118
7Gemini 3.8 Flash(Low) (Axis Spatial run: native=gemini-3-8-flash-low, cfg=8d9091d19a9cfcc1)76#39
8GPT-6 Sol(Medium) (Axis Spatial run: native=codex-gpt-6-sol-medium, cfg=9cfd2a064105bb74)75#29
9Claude Opus 5(High) (Axis Spatial run: native=claude-code-claude-opus-5-high, cfg=6285e6a048aeccf0)74.67#23
10GPT-6 Luna(High) (Axis Spatial run: native=codex-gpt-6-luna-high, cfg=844ad78a5b6cd008)74#105
11Gemini 3.1 Pro (Preview)(Low) (Axis Spatial run: native=gemini-3-1-pro-preview-low, cfg=96fc81922ecbd1db)74#99
12Claude Opus 4.8(High) (Axis Spatial run: native=claude-code-claude-opus-4-8-high, cfg=5dcc0d54f0927527)73.33#62
13Claude Opus 4.7(High) (Axis Spatial run: native=claude-code-claude-opus-4-7-high, cfg=d1b9c219cbc0f072)72.67#82
14DeepSeek V4 Pro(High) (Axis Spatial run: native=codex-deepseek-v4-pro-high, cfg=21c081d31d0b1e76)71.59#198
15GLM-5.3 Flash(Max) (Axis Spatial run: native=claude-code-glm-5-3-flash-max, cfg=51278108e969227a)70.83#136

Interactive version: theaggregate.ai/benchmark?slug=axis-spatial-v2-geobenchx · How It Works · Data refreshed daily, snapshot 2026-11-17.