neuralCAD-Edit - Valid Output Rate: leaderboard
neuralCAD-Edit (Autodesk AI Lab, 2026) is an expert benchmark for multimodal-instructed 3D CAD editing: designers record edit requests while talking, pointing and drawing, and models edit the CAD model by writing CadQuery scripts in a common harness. This board is the percentage of edits that produce a valid CAD model; higher is better.
Metric: Validity (from 0-1, times 100): share of edits that produce a valid CAD model, on the 192 neuralCAD-Edit requests (expert CAD designers' video, speech, drawing and text edit requests on Autodesk Fusion models), the model editing the input STEP model by writing and re-running CadQuery scripts in the authors' harness with visual inspection; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 | 99 | #185 |
| 2 | Gemini 3 Pro | 58 | #145 |
| 3 | Claude Sonnet 4.5 | 42 | #261 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=neuralcad-edit-valid-output-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.