IndustryBench - Selection and Substitution: leaderboard

IndustryBench (2026) restricted to its 649 Selection and Substitution questions (model selection, substitution and performance comparison), Chinese industrial procurement QA answered closed-book in default non-reasoning mode and scored 0 to 3 by a Qwen3-Max judge, with answers that violate a safety clause set to 0. Mean score out of 3; higher is better.

Metric: Final (SV) score (out of 3): mean 0-3 rubric score from a Qwen3-Max judge against the reference answer, set to 0 for any answer with a safety violation against the source standard; closed-book, zero-shot, provider-default decoding, over the 649 items of the 2,049 Chinese industrial procurement QA items of IndustryBench grounded in Chinese national standards (GB/T) in the Selection and Substitution capability dimension (model selection, substitution and performance comparison; default non-reasoning runs); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.4Non-reasoning2.19#135
2Claude Opus 4.62.12#113
3Gemini 3.1 Pro (Preview)2.11#99
4Qwen 3.5 PlusNon-reasoning2.08#242
5Qwen 3.5 397B A17BNon-reasoning2.08#264
6Qwen 3.6 PlusNon-reasoning2.07#238
7Qwen 3 MaxNon-reasoning2.04#415
8GPT-5.2Non-reasoning2.03#185
9Qwen 3.5 122B A10BNon-reasoning2.03#346
10Kimi K2.5Non-reasoning2#266
11Qwen 3.5 27BNon-reasoning1.92#375
12Claude Sonnet 4.61.89#173
13MiniMax-M2.51.85#600
14Qwen 3.5 35B A3BNon-reasoning1.8#492
15GLM-5Non-reasoning1.78#269

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=industrybench-selection-and-substitution · How It Works · Data refreshed daily, snapshot 2026-11-21.