AnalogLayoutWorld - Overall: leaderboard
AnalogLayoutWorld (arXiv 2611.16991v1, Table 1) evaluates analog circuit layout from fixed netlists, specifications and a SkyWater process design kit. There are 40 tasks, with three independent trials per task and a three-hour agent budget. Official grading starts after agent termination, outside that budget. Each native model, harness and reasoning setting remains distinct. GPT models use their API; other models run locally with SGLang. DRC, LVS, simulation and full acceptance use all task attempts as their denominator. Simulation passes only when all prescribed post-layout cases pass. Engineering quality is the eligibility-gated E_t Q_t value. The overall score is the native weighted task score, with submission, physical, geometry, morphology and electrical checks; it is not an unweighted mean of the displayed columns. Area, tokens and tool calls remain diagnostics. The unbound in-house Novara system is retained separately for identity review. Mean native weighted score, on a 0–1 scale. Higher is better.
Metric: Native mean score (0-1). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Astra | Max | 0.7483 | #6 |
| 2 | GPT-6.1 Sol | Max | 0.7023 | #10 |
| 3 | GLM-5.3 | Max | 0.4779 | #68 |
| 4 | GLM-5.3 (Max) (Harness: InternBootcamp) | 0.4632 | ||
| 5 | Kimi K3 | Max | 0.29 | #56 |
| 6 | Qwen3.8-Flash-Next | xHigh | 0.2633 | #117 |
| 7 | GLM-5.3 Flash | Max | 0.2555 | #125 |
| 8 | GLM-5.3 Flash (Max) (Harness: InternBootcamp) | 0.2378 | ||
| 9 | DeepSeek V4.1 Flash | Max | 0.1974 | #62 |
| 10 | DeepSeek V4 Pro | Max | 0.1504 | #191 |
| 11 | GLM-5.2 (FP8) | Max | 0.1075 | |
| 12 | Kimi K2.6 | Max | 0.0958 | #181 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=analoglayoutworld-overall · How It Works · Data refreshed daily, snapshot 2026-11-16.