AnalogLayoutWorld - LVS Pass Rate: leaderboard

AnalogLayoutWorld (arXiv 2611.16991v1, Table 1) evaluates analog circuit layout from fixed netlists, specifications and a SkyWater process design kit. There are 40 tasks, with three independent trials per task and a three-hour agent budget. Official grading starts after agent termination, outside that budget. Each native model, harness and reasoning setting remains distinct. GPT models use their API; other models run locally with SGLang. DRC, LVS, simulation and full acceptance use all task attempts as their denominator. Simulation passes only when all prescribed post-layout cases pass. Engineering quality is the eligibility-gated E_t Q_t value. The overall score is the native weighted task score, with submission, physical, geometry, morphology and electrical checks; it is not an unweighted mean of the displayed columns. Area, tokens and tool calls remain diagnostics. The unbound in-house Novara system is retained separately for identity review. Layout-versus-schematic pass rate, in percent. Higher is better.

Metric: Pass rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-6 AstraMax98.3#6
2GPT-6.1 SolMax91.7#10
3GLM-5.3Max69.2#68
4GLM-5.3 (Max) (Harness: InternBootcamp)65
5Qwen3.8-Flash-NextxHigh41.7#117
6Kimi K3Max40#56
7GLM-5.3 FlashMax33.3#125
8GLM-5.3 Flash (Max) (Harness: InternBootcamp)30
9DeepSeek V4.1 FlashMax29.2#62
10DeepSeek V4 ProMax23.3#191
11GLM-5.2 (FP8)Max10
12Kimi K2.6Max0#181

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=analoglayoutworld-lvs-pass-rate · How It Works · Data refreshed daily, snapshot 2026-11-16.