PCB-Bench - Basic Wiring Error Identification: leaderboard

Identify the wiring fault in a PCB netlist or schematic — shorts, opens, misrouted nets — on a small item set, so scores move in coarse steps.

Metric: Accuracy (%). Source: digailab.github.io. Saturation forecast: Estimated already saturated. 9 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro100#152
2GPT-590.9#98
3GPT-5 Nano72.72#425
4Llama 4 Maverick54.54#464
5Gemini 2.5 Flash Lite54.54#422
6Qwen 3 VL 235B A22B (Thinking)54.54#238 (Qwen 3 VL 235B A22B)
7Qwen 3 VL 8B Instruct45.45#420
8InternVL3-78B45.45#352

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=pcb-bench-basic-wiring-error-identification · How It Works · Data refreshed daily, snapshot 2026-10-20.