OmniSch - Graph IoU: leaderboard

Metric: Graph IoU (x100): intersection over union of the predicted and ground-truth edge sets (symbol-pin membership and pin-pin connectivity edges) on the industrial-EDA (Real) schematics of the OmniSch held-out test split, the model converting each PCB schematic image into a spatially weighted netlist graph with one zero-shot prompt, predicted and reference nodes aligned by maximum-weight bipartite matching; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 9 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)17.71
2GPT-5.215.46
3Claude Sonnet 4.612.41
4Qwen 3.5 122B A10B11.79
5Ministral 3 14B8.25
6GPT-5 Mini7.04
7Llama 4 Maverick4.75
8Qwen 3 VL 8B Instruct0.23

Interactive version: theaggregate.ai/benchmark?slug=omnisch-graph-iou · How It Works · Data refreshed daily, snapshot 2026-10-07.