AA-Omniscience Index - Software Engineering (SWE): leaderboard
Artificial Analysis's AA-Omniscience Index on the Software Engineering (SWE) questions of its 3,000-question v1.1 factual-recall benchmark: the share of correct answers minus the share of incorrect ones, bounded -100 to 100, so abstaining beats guessing wrong. Higher is better and negative scores are common. Scores are not directly comparable with v1, which had 6,000 questions. Not the accuracy carried by the frozen AA Omniscience domain boards.
Metric: Omniscience Index. Source: artificialanalysis.ai. Saturation forecast: Around March 2027. 117 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra (xHigh) | 78.33 | #6 (GPT-6 Astra) |
| 2 | GPT-6.1 Sol (Max) | 77.5 | #7 (GPT-6.1 Sol) |
| 3 | Gemini 4 Carbon (High) | 76.5 | #1 (Gemini 4 Carbon) |
| 4 | GPT-6.1 Sol (High) | 76.33 | #7 (GPT-6.1 Sol) |
| 5 | GPT-6 Astra (High) | 75.5 | #6 (GPT-6 Astra) |
| 6 | GPT-6 Astra (Medium) | 75 | #6 (GPT-6 Astra) |
| 7 | GPT-6.1 Sol (xHigh) | 75 | #7 (GPT-6.1 Sol) |
| 8 | GPT-6 Astra (Low) | 74.33 | #6 (GPT-6 Astra) |
| 9 | GPT-6.1 Sol (Medium) | 73.83 | #7 (GPT-6.1 Sol) |
| 10 | GPT-6 Astra (Max) | 73.67 | #6 (GPT-6 Astra) |
| 11 | GPT-6.1 Sol (Low) | 69.83 | #7 (GPT-6.1 Sol) |
| 12 | Gemini 4 Argon (High) | 66.5 | #9 (Gemini 4 Argon) |
| 13 | GPT-6.1 Terra (Max) | 64.83 | #15 (GPT-6.1 Terra) |
| 14 | GPT-6.1 Terra (High) | 64.5 | #15 (GPT-6.1 Terra) |
| 15 | GPT-6.1 Terra (xHigh) | 64.33 | #15 (GPT-6.1 Terra) |
No result here: #3 Claude Opus 5.5, #10 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=aa-omniscience-index-software-engineering-swe · How It Works · Data refreshed daily, snapshot 2026-11-05.