MM-IssueLoc - Function Localization: leaderboard

MM-IssueLoc tests whether repository-level localization systems use screenshots and other issue images to identify the functions responsible for a software issue; scored by function Acc@10 with the best harness retained per underlying LLM.

Metric: Function Acc@10 (%). Source: arxiv.org. 12 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.222.45#110
2Claude Sonnet 4.620.41#90
3Kimi K2.520.12#144
4Qwen 3.5 122B A10B12.98#173
5Gemini 3 Pro12.92#80

Interactive version: theaggregate.ai/benchmark?slug=mm-issueloc-function-localization · How It Works · Data refreshed daily, snapshot 2026-10-20.