AA Coding Agent Index v2.1 - SWE-Atlas-QnA-AA: leaderboard
Artificial Analysis Coding Agent Index v2.1 (November 2026) evaluates a model inside its named coding-agent harness. It averages FrontierCode-AA 2.0 (132 repository-editing tasks), Terminal-Bench 4.1 (66 terminal tasks with revised verifiers), and SWE-Atlas-QnA-AA (124 repository questions), each using three attempts per task and task-equal means. Audited reward-hacking attempts score zero; environment/verifier errors are excluded. Native model effort and harness remain separate; this edition differs from v2.0. This board reports SWE-Atlas-QnA-AA, higher is better.
Metric: Task Resolve Rate (%). Source: artificialanalysis.ai. Saturation forecast: Around 2029. 23 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Muse Wonder Full | Max | 68.82 | #17 |
| 2 | Claude Fable 5.1 | Max, Default Fallback, AA Coding Agent Run: harness=Claude Code; native=Claude Fable 5.1 (Max, Default Fallback); fallback=source-published | 66.4 | #15 |
| 3 | Claude Opus 5.5 | Max, Default Fallback, AA Coding Agent Run: harness=Claude Code; native=Claude Opus 5.5 (Max, Default Fallback); fallback=source-published | 65.86 | #5 |
| 4 | Claude Sonnet 5.5 | Max, Default Fallback, AA Coding Agent Run: harness=Claude Code; native=Claude Sonnet 5.5 (Max, Default Fallback); fallback=source-published | 64.25 | #19 |
| 5 | Gemini 4 Carbon | High | 63.71 | #2 |
| 6 | Claude Fable 5.2 | Medium, Default Fallback, AA Coding Agent Run: harness=Claude Code; native=Claude Fable 5.2 (Medium, Default Fallback); fallback=source-published | 63.71 | #1 |
| 7 | Grok 4.7 | xHigh | 62.9 | #47 |
| 8 | DeepSeek V4.1 Flash (1017) | Max | 61.56 | #41 |
| 9 | Muse Wonder | Max | 61.56 | #28 |
| 10 | GPT-6.1 Sol | Max | 59.95 | #10 |
| 11 | GPT-6 Astra | Max | 59.14 | #6 |
| 12 | Mistral Large 4 | High | 58.87 | #137 |
| 13 | GLM-5.3 | Max | 58.6 | #68 |
| 14 | Muse Spark 1.3 | Max | 58.6 | #43 |
| 15 | Step 5 Preview | 58.6 | #110 |
Interactive version: theaggregate.ai/benchmark?slug=aa-coding-agent-index-v2-1-swe-atlas-qna-aa · How It Works · Data refreshed daily, snapshot 2026-11-16.