SWE-bench Multimodal — leaderboard

SWE-bench extension with 517 software issues that include visual elements such as screenshots, mockups, diagrams, and visual error context.

Source: swebench.com.

Interactive version: theaggregate.ai/benchmark?slug=swe-bench-multimodal · How the rankings work · Data refreshed daily, snapshot 2026-07-22.