SWE-bench Live Java (62 tasks, Claude Code): leaderboard
SWE-bench-Live's Java split (Microsoft, 2026 multi-language update): recent GitHub issues from Java repositories, built into runnable environments by the RepoLaunch pipeline and graded by the repository's tests. This board is the 62-task snapshot under the Claude Code agent, scored as the percentage of tasks resolved; higher is better. The split grows, so each snapshot size is its own board.
Metric: Resolved rate (%). Source: swe-bench-live.github.io. Saturation forecast: Around April 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 (Medium) | 37.1 | #172 (GPT-5.2) |
| 2 | Claude Sonnet 4.5 | 27.42 | #244 |
| 3 | DeepSeek V3.1 Terminus | 22.58 | #442 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=swe-bench-live-java-62-tasks-claude-code · How It Works · Data refreshed daily, snapshot 2026-11-12.