CircuitReason-1k: leaderboard
CircuitReason-1k (2026) pairs 1,000 authentic textbook circuit-analysis problems with their diagrams and reference solutions to test long-horizon visual-to-symbolic reasoning: reading the diagram, recovering topology, formulating equations and carrying units, signs and phases to the final answer. Accuracy in percent with every problem in the denominator, scored by typed deterministic rules where possible and by an identity-blinded multi-model judge majority against the gold answer otherwise; higher is better.
Metric: Accuracy (%; exact problem-level correctness on all 1,000 of CircuitReason-1k's authentic textbook circuit problems; typed deterministic scoring for 585 problems and identity-blinded, reference-assisted multi-model judge consensus (strict majority of at least three votes) for the other 415; every requested output must be correct; missing, failed or unresolved answers count as wrong; image and question only, no output-token cap, open models in their native thinking mode). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol | 84.8 | #29 |
| 2 | Qwen 3.5 122B A10B | 84.3 | #329 |
| 3 | Kimi K2.6 | 84 | #173 |
| 4 | Gemini 3.1 Pro (Preview) | 82.3 | #91 |
| 5 | Claude Sonnet 4.6 | 64.4 | #158 |
| 6 | Qwen 3 VL 235B A22B (Thinking) | 64 | #451 |
| 7 | Qwen 3 VL 8B (Thinking) | 43.8 | #887 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=circuitreason-1k · How It Works · Data refreshed daily, snapshot 2026-11-12.