Axis Spatial v2 - GS-QA2: leaderboard
Spatial Agent Index v2, separate from methodology1.0 observations. One attempt per task, 60turns and7200seconds; native reasoning/harness defaults, output cap65536except native ClaudeCode/Codex. Provider calls retry up to9times; persistent failed trajectories rerun, at most1%after3reruns omitted. Refusals score0. A timeout with over half time waiting on provider reruns. Unattempted/unjudged maps omitted; passing attempts awaiting trace review count as passes. Trace failure is limited to obtaining answer/check content or external answers. Claude Sonnet5.5 high judges maps and traces, including its own family. Nominal Vision pool128built minus47excluded=81; source history adds22ThinkGeo tasks, while an older106-42=64paragraph is stale. Native per-entry scored denominators remain unreported. Same-model/effort Stirrup Vision results may supply Terminus2 entries. At least75%view completion qualifies a source index entry; default charts select model families and do not define our retained roster. Metric: Template-macro pass@1 (%). Source: https://www.axisspatial.com/arena/agent-index
Metric: Template-macro pass@1 (%). Source: www.axisspatial.com. Saturation forecast: Rough model projection: around 2026. 48 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5.6 Sol | (Medium) (Axis Spatial run: native=codex-gpt-5-6-sol-medium, cfg=be3121784a554e4a) | 100 | #33 |
| 2 | Claude Opus 5.5 | (xHigh) (Axis Spatial run: native=claude-code-claude-opus-5-5-xhigh, cfg=ca49c6089c798424) | 94.35 | #7 |
| 3 | GPT-6.1 Sol | (xHigh) (Axis Spatial run: native=codex-gpt-6-1-sol-xhigh, cfg=006589addbd990d4) | 94.35 | #12 |
| 4 | Claude Sonnet 5.5 | (Max) (Axis Spatial run: native=claude-code-claude-sonnet-5-5-max, cfg=1a0dae0f304eb46f) | 91.97 | #21 |
| 5 | Claude Opus 5 | (High) (Axis Spatial run: native=claude-code-claude-opus-5-high, cfg=6285e6a048aeccf0) | 91.09 | #23 |
| 6 | Claude Fable 5.1 | (High) (Axis Spatial run: native=claude-code-claude-fable-5-1-high, cfg=f33f64f05b3a21e3) | 89.52 | #17 |
| 7 | DeepSeek V4.1 Flash | (Max) (Axis Spatial run: native=codex-deepseek-v4-1-flash-max, cfg=fc93ddd15ae4274d) | 89.29 | #69 |
| 8 | GPT-6 Sol | (High) (Axis Spatial run: native=codex-gpt-6-sol-high, cfg=ae5240bfecfa39f4) | 88.71 | #29 |
| 9 | Claude Haiku 5.5 | (Max) (Axis Spatial run: native=claude-code-claude-haiku-5-5-max, cfg=5ca9034a64cb2ec2) | 86.8 | #76 |
| 10 | Gemini 3.8 Flash | (Low) (Axis Spatial run: native=gemini-3-8-flash-low, cfg=8d9091d19a9cfcc1) | 85.88 | #39 |
| 11 | GPT-5.6 Luna | (xHigh) (Axis Spatial run: native=codex-gpt-5-6-luna-xhigh, cfg=68e5bac9c70f9b62) | 85.03 | #130 |
| 12 | Kimi K3 | (Reasoning) (Axis Spatial run: native=kimi-code-kimi-k3-always-on, cfg=fb91857695683970) | 84.76 | #59 |
| 13 | Claude Opus 4.8 | (High) (Axis Spatial run: native=claude-code-claude-opus-4-8-high, cfg=5dcc0d54f0927527) | 83.67 | #62 |
| 14 | GLM-5.2 | (Max) (Axis Spatial run: native=claude-code-glm-5-2-max, cfg=eb741e1eb6bdfc0d) | 82.65 | #152 |
| 15 | GLM-5.3 | (Max) (Axis Spatial run: native=glm-5-3-max-default, cfg=40bf2a829b121abe) | 82.59 | #73 |
Interactive version: theaggregate.ai/benchmark?slug=axis-spatial-v2-gs-qa2 · How It Works · Data refreshed daily, snapshot 2026-11-17.