DiagnosticIQ Pro: leaderboard

DiagnosticIQ Pro (2026) is the 10-option variant of DiagnosticIQ, which asks which maintenance action an engineer-authored symbolic sensor rule calls for across 16 industrial asset types. Macro accuracy in percent over the asset types, zero-shot at temperature 0; higher is better.

Metric: Macro accuracy (%) on DiagnosticIQ Pro, the 10-option variant of each question (mean of the 16 per-asset accuracies), zero-shot multiple choice, temperature 0, at most 4,096 output tokens; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 30 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Opus 4.659.81#113
2GPT-5.459.21#135
3Gemini 3.1 Pro (Preview)57.74#99
4Claude 3.7 Sonnet56.63#470
5Qwen 3.6 35B A3B55.61#481
6Gemma 4 26B A4B47.65#590
7Claude Sonnet 4.647.21#173
8Gemma 4 31B45.18#382
9Llama 4 Maverick42.65#1110
10Granite 3.3 8B Instruct42.39#3866
11DeepSeek V341.38#729
12DiagnosticIQ Mistral-Large (checkpoint unspecified)41.13
13GPT-540.69#178
14Llama 3.1 405B38.82#1082
15Gemini 2.5 Pro37.51#276

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=diagnosticiq-pro · How It Works · Data refreshed daily, snapshot 2026-11-21.