AnalogLayoutWorld - Post-Layout Simulation Pass Rate: leaderboard

AnalogLayoutWorld (arXiv 2611.16991v1, Table 1) evaluates analog circuit layout from fixed netlists, specifications and a SkyWater process design kit. There are 40 tasks, with three independent trials per task and a three-hour agent budget. Official grading starts after agent termination, outside that budget. Each native model, harness and reasoning setting remains distinct. GPT models use their API; other models run locally with SGLang. DRC, LVS, simulation and full acceptance use all task attempts as their denominator. Simulation passes only when all prescribed post-layout cases pass. Engineering quality is the eligibility-gated E_t Q_t value. The overall score is the native weighted task score, with submission, physical, geometry, morphology and electrical checks; it is not an unweighted mean of the displayed columns. Area, tokens and tool calls remain diagnostics. The unbound in-house Novara system is retained separately for identity review. All prescribed electrical simulation cases must pass; percentage of all attempts. Higher is better.

Metric: Pass rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-6 AstraMax82.5#6
2GPT-6.1 SolMax80#10
3GLM-5.3 (Max) (Harness: InternBootcamp)45
4GLM-5.3Max42.5#68
5Kimi K3Max30#56
6Qwen3.8-Flash-NextxHigh25#117
7GLM-5.3 FlashMax22.5#125
8GLM-5.3 Flash (Max) (Harness: InternBootcamp)22.5
9DeepSeek V4.1 FlashMax17.5#62
10DeepSeek V4 ProMax12.5#191
11GLM-5.2 (FP8)Max5
12Kimi K2.6Max0#181

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=analoglayoutworld-post-layout-simulation-pass-rate · How It Works · Data refreshed daily, snapshot 2026-11-16.