AnalogLayoutWorld - LVS Pass Rate: leaderboard
AnalogLayoutWorld (arXiv 2611.16991v1, Table 1) evaluates analog circuit layout from fixed netlists, specifications and a SkyWater process design kit. There are 40 tasks, with three independent trials per task and a three-hour agent budget. Official grading starts after agent termination, outside that budget. Each native model, harness and reasoning setting remains distinct. GPT models use their API; other models run locally with SGLang. DRC, LVS, simulation and full acceptance use all task attempts as their denominator. Simulation passes only when all prescribed post-layout cases pass. Engineering quality is the eligibility-gated E_t Q_t value. The overall score is the native weighted task score, with submission, physical, geometry, morphology and electrical checks; it is not an unweighted mean of the displayed columns. Area, tokens and tool calls remain diagnostics. The unbound in-house Novara system is retained separately for identity review. Layout-versus-schematic pass rate, in percent. Higher is better.
Metric: Pass rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Astra | Max | 98.3 | #6 |
| 2 | GPT-6.1 Sol | Max | 91.7 | #10 |
| 3 | GLM-5.3 | Max | 69.2 | #68 |
| 4 | GLM-5.3 (Max) (Harness: InternBootcamp) | 65 | ||
| 5 | Qwen3.8-Flash-Next | xHigh | 41.7 | #117 |
| 6 | Kimi K3 | Max | 40 | #56 |
| 7 | GLM-5.3 Flash | Max | 33.3 | #125 |
| 8 | GLM-5.3 Flash (Max) (Harness: InternBootcamp) | 30 | ||
| 9 | DeepSeek V4.1 Flash | Max | 29.2 | #62 |
| 10 | DeepSeek V4 Pro | Max | 23.3 | #191 |
| 11 | GLM-5.2 (FP8) | Max | 10 | |
| 12 | Kimi K2.6 | Max | 0 | #181 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=analoglayoutworld-lvs-pass-rate · How It Works · Data refreshed daily, snapshot 2026-11-16.