IndustryCode - MATLAB Sub-Problems: leaderboard

IndustryCode (2026) is a code-generation benchmark of hierarchical industrial programming problems in Python, C++, MATLAB and Stata, each main problem decomposed into sub-problems checked by test cases. This board is Pass@1 in percent on the MATLAB sub-problems, each generated with the earlier steps as context; higher is better.

Metric: Pass@1 (%) on the MATLAB sub-problems of the IndustryCode test split (106 main problems decomposed into 499 sub-problems; industrial Python, C++, MATLAB and Stata projects with test cases), each sub-problem generated with the main-problem description and the code of earlier steps as context; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 Pro77.9#145
2Claude Sonnet 4.574.3#261
3Claude Opus 4.572.8#160
4Seed 1.8Non-reasoning67.1#252
5Claude Haiku 4.564.3#583
6Gemini 2.5 Pro60#276
7Grok 4.154.2#462
8Kimi K250.7#443
9Qwen 3 MaxThinking49.3#415
10GPT-5.247.1#185
11GPT-5.147.1#240
12Seed-1.6Non-reasoning46.4#469
13GLM-4.7Non-reasoning45#380
14Kimi K2 (Thinking)40
15Qwen 3 Coder Plus40#720

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=industrycode-matlab-sub-problems · How It Works · Data refreshed daily, snapshot 2026-11-21.