MMPCBench - Diagnostic Precision: leaderboard
Metric: Judge-panel score (0-2; detected errors only). Source: arxiv.org. 14 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.1 (High) | 1.79 |
| 2 | GPT-5 Mini | 1.75 |
| 3 | GPT-5.2 | 1.66 |
| 4 | Claude Sonnet 4.5 (Thinking) | 1.66 |
| 5 | Gemini 3 Flash | 1.51 |
| 6 | GLM-4.6V | 1.51 |
| 7 | Qwen 3 VL 235B A22B Instruct | 1.47 |
| 8 | Gemini 3 Pro | 1.46 |
| 9 | Qwen 3 VL 30B A3B Instruct | 1.37 |
| 10 | Qwen 3 VL 8B Instruct | 1.36 |
| 11 | Gemma 3 27B (IT) | 1.3 |
| 12 | Gemma 3 12B (IT) | 1.27 |
| 13 | Gemma 3 4B (IT) | 0.91 |
Interactive version: theaggregate.ai/benchmark?slug=mmpcbench-diagnostic-precision · How It Works · Data refreshed daily, snapshot 2026-09-19.