OpenHands Index - SWE-bench Multimodal — leaderboard

Metric: Score (%). Source: huggingface.co. 5 models tracked.

Top models

#ModelScore
1OpenHands CodeAct v2.1 (claude-3-5-sonnet-20241022)42.1
2OpenHands CodeAct v2.0 (gpt-4o-2024-11-20)39.5
3AutoCodeRover (gpt-4-turbo-2024-04-09)34.2
4Agentless (gpt-4o-mini-2024-07-18)28.9
5SWE-Agent (claude-3-opus-20240229)25.7

Interactive version: theaggregate.ai/benchmark?slug=openhands-index-swe-bench-multimodal · How the rankings work · Data refreshed daily, snapshot 2026-07-22.