sudo L7: leaderboard
sudo L7 (Surge AI, 2026): 60 software-engineering assignments written by staff-level-or-above engineers, mostly in private production codebases at real companies plus open-source projects (one repository is roughly 250,000 lines), across backend, frontend, security, reliability and architecture work. Requests are open-ended ("Make this faster.", "Can we safely cache this?"), and the right output can be code, an architectural analysis, a rollout plan or a recommendation not to make the change. Unlike SWE-bench, which checks whether a patch for a GitHub issue passes the relevant tests, "sudo L7 asks what happens after the patch is correct": grader models apply expert-written, task-specific criteria across eight dimensions of engineering behaviour, among them functional correctness, practical judgment, thought partnership, verification and truthful reporting, using unit tests, static analysis and other executable checks as evidence. Score (%): the launch post describes it as the share of assignments an agent succeeds on; neither the page nor the post defines the success criterion, attempts or harness further. Reasoning effort as labelled. Higher is better. Source: https://surgehq.ai/benchmarks/sudo-l7
Metric: Score (%). Source: surgehq.ai. Saturation forecast: Around 2029. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6.1 Sol (Max) | 33.9 | #7 (GPT-6.1 Sol) |
| 2 | Claude Fable 5.1 (Max) | 32.2 | #10 (Claude Fable 5.1) |
| 3 | GPT-6 Astra (Max) | 31.1 | #6 (GPT-6 Astra) |
| 4 | Kimi K3.1 Pro (Max) | 16.7 | #17 (Kimi K3.1 Pro) |
| 5 | Qwen 3.8 Max (xHigh) | 16.7 | #34 (Qwen 3.8 Max) |
| 6 | Gemini 4 Argon (High) | 16.1 | #9 (Gemini 4 Argon) |
| 7 | Muse Wonder (Max) | 16.1 | #18 (Muse Wonder) |
| 8 | Hy4 preview (High) | 15.6 | #45 (Hy4 preview) |
| 9 | Mistral Large 4 (High) | 13.9 | #106 (Mistral Large 4) |
| 10 | Muse Spark 1.3 (Max) | 12.8 | #31 (Muse Spark 1.3) |
| 11 | Kimi K3 (Max) | 12.2 | #35 (Kimi K3) |
| 12 | Grok 4.7 (xHigh) | 12.2 | #26 (Grok 4.7) |
| 13 | Gemini 3.8 Flash (High) | 10.6 | #30 (Gemini 3.8 Flash) |
| 14 | GLM-5.3 (Max) | 9.4 | #44 (GLM-5.3) |
Interactive version: theaggregate.ai/benchmark?slug=sudo-l7 · How It Works · Data refreshed daily, snapshot 2026-11-05.