LLM Stats (SWE Atlas - Codebase QnA): leaderboard
SWE Atlas Codebase QnA evaluates repository-level code comprehension: answering questions about code structure, behavior and intent across real software projects. LLM Stats mirrors reported results as percentages.
Metric: Score (%). Source: llm-stats.com. Saturation forecast: Around July 2027. 8 models tracked. Updated 13 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Mistral Large 4 Preview | 59.4 | #206 | |
| 2 | Muse Spark 1.3 | 59.4 | #50 | |
| 3 | Muse Spark Open | 58 | #82 | |
| 4 | SWE-2 Flash | 50 | #73 | |
| 5 | K2 Horizon 375B A23B | High | 48.4 | #291 |
| 6 | Laguna S 2.1 | 46.2 | #768 | |
| 7 | MiniMax-M3 | 37.9 | #290 | |
| 8 | Beam 1.0 | 31.8 | #215 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=llm-stats-swe-atlas-codebase-qna · How It Works · Data refreshed daily, snapshot 2026-11-22.