DiagnosticIQ Pro: leaderboard
DiagnosticIQ Pro (2026) is the 10-option variant of DiagnosticIQ, which asks which maintenance action an engineer-authored symbolic sensor rule calls for across 16 industrial asset types. Macro accuracy in percent over the asset types, zero-shot at temperature 0; higher is better.
Metric: Macro accuracy (%) on DiagnosticIQ Pro, the 10-option variant of each question (mean of the 16 per-asset accuracies), zero-shot multiple choice, temperature 0, at most 4,096 output tokens; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 30 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 59.81 | #113 |
| 2 | GPT-5.4 | 59.21 | #135 |
| 3 | Gemini 3.1 Pro (Preview) | 57.74 | #99 |
| 4 | Claude 3.7 Sonnet | 56.63 | #470 |
| 5 | Qwen 3.6 35B A3B | 55.61 | #481 |
| 6 | Gemma 4 26B A4B | 47.65 | #590 |
| 7 | Claude Sonnet 4.6 | 47.21 | #173 |
| 8 | Gemma 4 31B | 45.18 | #382 |
| 9 | Llama 4 Maverick | 42.65 | #1110 |
| 10 | Granite 3.3 8B Instruct | 42.39 | #3866 |
| 11 | DeepSeek V3 | 41.38 | #729 |
| 12 | DiagnosticIQ Mistral-Large (checkpoint unspecified) | 41.13 | |
| 13 | GPT-5 | 40.69 | #178 |
| 14 | Llama 3.1 405B | 38.82 | #1082 |
| 15 | Gemini 2.5 Pro | 37.51 | #276 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=diagnosticiq-pro · How It Works · Data refreshed daily, snapshot 2026-11-21.