Claw-SWE-Bench (OpenClaw): leaderboard

Claw-SWE-Bench (2026) compares general-purpose agent harnesses (claws) on SWE-bench-style issue resolution: 350 multilingual GitHub issues run under a fixed prompt, time budget, patch extraction and evaluator. This board is Pass@1 in percent with the OpenClaw harness; higher is better.

Metric: Pass@1 (%) on the 350 GitHub issue-resolution instances of Claw-SWE-Bench (8 languages, 43 repositories, from SWE-bench-Multilingual and SWE-bench-Verified-Mini after future-commit cleanup); full adapter, identical prompt, 60-minute per-instance budget, one run, SWE-bench evaluator; OpenClaw harness. Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.578#49
2Claude Opus 4.777.1#79
3GLM-5.173.4#179
4DeepSeek V4 Pro71.7#188
5DeepSeek V4 Flash70.3#258
6Kimi K2.666.9#178
7Qwen 3.6 Flash66#424
8MiniMax-M2.761.4#518
9Seed 2.0 Mini48.6#508

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=claw-swe-bench-openclaw · How It Works · Data refreshed daily, snapshot 2026-11-13.