Axis Spatial v2 - GS-QA2: leaderboard

Spatial Agent Index v2, separate from methodology1.0 observations. One attempt per task, 60turns and7200seconds; native reasoning/harness defaults, output cap65536except native ClaudeCode/Codex. Provider calls retry up to9times; persistent failed trajectories rerun, at most1%after3reruns omitted. Refusals score0. A timeout with over half time waiting on provider reruns. Unattempted/unjudged maps omitted; passing attempts awaiting trace review count as passes. Trace failure is limited to obtaining answer/check content or external answers. Claude Sonnet5.5 high judges maps and traces, including its own family. Nominal Vision pool128built minus47excluded=81; source history adds22ThinkGeo tasks, while an older106-42=64paragraph is stale. Native per-entry scored denominators remain unreported. Same-model/effort Stirrup Vision results may supply Terminus2 entries. At least75%view completion qualifies a source index entry; default charts select model families and do not define our retained roster. Metric: Template-macro pass@1 (%). Source: https://www.axisspatial.com/arena/agent-index

Metric: Template-macro pass@1 (%). Source: www.axisspatial.com. Saturation forecast: Rough model projection: around 2026. 48 models tracked. Updated 17 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.6 Sol(Medium) (Axis Spatial run: native=codex-gpt-5-6-sol-medium, cfg=be3121784a554e4a)100#33
2Claude Opus 5.5(xHigh) (Axis Spatial run: native=claude-code-claude-opus-5-5-xhigh, cfg=ca49c6089c798424)94.35#7
3GPT-6.1 Sol(xHigh) (Axis Spatial run: native=codex-gpt-6-1-sol-xhigh, cfg=006589addbd990d4)94.35#12
4Claude Sonnet 5.5(Max) (Axis Spatial run: native=claude-code-claude-sonnet-5-5-max, cfg=1a0dae0f304eb46f)91.97#21
5Claude Opus 5(High) (Axis Spatial run: native=claude-code-claude-opus-5-high, cfg=6285e6a048aeccf0)91.09#23
6Claude Fable 5.1(High) (Axis Spatial run: native=claude-code-claude-fable-5-1-high, cfg=f33f64f05b3a21e3)89.52#17
7DeepSeek V4.1 Flash(Max) (Axis Spatial run: native=codex-deepseek-v4-1-flash-max, cfg=fc93ddd15ae4274d)89.29#69
8GPT-6 Sol(High) (Axis Spatial run: native=codex-gpt-6-sol-high, cfg=ae5240bfecfa39f4)88.71#29
9Claude Haiku 5.5(Max) (Axis Spatial run: native=claude-code-claude-haiku-5-5-max, cfg=5ca9034a64cb2ec2)86.8#76
10Gemini 3.8 Flash(Low) (Axis Spatial run: native=gemini-3-8-flash-low, cfg=8d9091d19a9cfcc1)85.88#39
11GPT-5.6 Luna(xHigh) (Axis Spatial run: native=codex-gpt-5-6-luna-xhigh, cfg=68e5bac9c70f9b62)85.03#130
12Kimi K3(Reasoning) (Axis Spatial run: native=kimi-code-kimi-k3-always-on, cfg=fb91857695683970)84.76#59
13Claude Opus 4.8(High) (Axis Spatial run: native=claude-code-claude-opus-4-8-high, cfg=5dcc0d54f0927527)83.67#62
14GLM-5.2(Max) (Axis Spatial run: native=claude-code-glm-5-2-max, cfg=eb741e1eb6bdfc0d)82.65#152
15GLM-5.3(Max) (Axis Spatial run: native=glm-5-3-max-default, cfg=40bf2a829b121abe)82.59#73

Interactive version: theaggregate.ai/benchmark?slug=axis-spatial-v2-gs-qa2 · How It Works · Data refreshed daily, snapshot 2026-11-17.