AnalogLayoutWorld - Eligible Engineering Quality: leaderboard
AnalogLayoutWorld (arXiv 2611.16991v1, Table 1) evaluates analog circuit layout from fixed netlists, specifications and a SkyWater process design kit. There are 40 tasks, with three independent trials per task and a three-hour agent budget. Official grading starts after agent termination, outside that budget. Each native model, harness and reasoning setting remains distinct. GPT models use their API; other models run locally with SGLang. DRC, LVS, simulation and full acceptance use all task attempts as their denominator. Simulation passes only when all prescribed post-layout cases pass. Engineering quality is the eligibility-gated E_t Q_t value. The overall score is the native weighted task score, with submission, physical, geometry, morphology and electrical checks; it is not an unweighted mean of the displayed columns. Area, tokens and tool calls remain diagnostics. The unbound in-house Novara system is retained separately for identity review. Native eligibility-gated engineering quality, on a 0–1 scale. Higher is better.
Metric: Native mean score (0-1). Source: arxiv.org. Saturation forecast: Around June 2027. 12 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Astra | Max | 0.566 | #6 |
| 2 | GPT-6.1 Sol | Max | 0.498 | #10 |
| 3 | GLM-5.3 | Max | 0.358 | #68 |
| 4 | GLM-5.3 (Max) (Harness: InternBootcamp) | 0.35 | ||
| 5 | Kimi K3 | Max | 0.167 | #56 |
| 6 | GLM-5.3 Flash | Max | 0.146 | #125 |
| 7 | Qwen3.8-Flash-Next | xHigh | 0.14 | #117 |
| 8 | GLM-5.3 Flash (Max) (Harness: InternBootcamp) | 0.117 | ||
| 9 | DeepSeek V4.1 Flash | Max | 0.086 | #62 |
| 10 | DeepSeek V4 Pro | Max | 0.049 | #191 |
| 11 | Kimi K2.6 | Max | 0 | #181 |
| 12 | GLM-5.2 (FP8) | Max | 0 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=analoglayoutworld-eligible-engineering-quality · How It Works · Data refreshed daily, snapshot 2026-11-16.