SWE-rebench V2 - Rust: leaderboard

Metric: pass@1 (%, 0-100) on the 60 Rust tasks, averaged over three runs; the SWE-rebench V2 diagnostic sample: 300 issue-resolution tasks drawn at random from the collection, 60 each in Python, JavaScript, Go, Rust and Scala, with pre-built Docker environments and fail-to-pass tests; mini-SWE-agent with default generation settings, three independent runs per task; higher is better. Source: arxiv.org. Saturation forecast: Around June 2028. 7 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.528.9#79
2GLM-4.724.4#185
3DeepSeek V3.221.7#198
4GPT-5.2 (Medium)21.7#105 (GPT-5.2)
5Gemini 3 Flash21.1#93
6MiniMax-M2.120.6#283
7GPT-OSS-120B9.4#330

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=swe-rebench-v2-rust · How It Works · Data refreshed daily, snapshot 2026-10-11.