neuralCAD-Edit - Valid Output Rate: leaderboard

neuralCAD-Edit (Autodesk AI Lab, 2026) is an expert benchmark for multimodal-instructed 3D CAD editing: designers record edit requests while talking, pointing and drawing, and models edit the CAD model by writing CadQuery scripts in a common harness. This board is the percentage of edits that produce a valid CAD model; higher is better.

Metric: Validity (from 0-1, times 100): share of edits that produce a valid CAD model, on the 192 neuralCAD-Edit requests (expert CAD designers' video, speech, drawing and text edit requests on Autodesk Fusion models), the model editing the input STEP model by writing and re-running CadQuery scripts in the authors' harness with visual inspection; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-5.299#185
2Gemini 3 Pro58#145
3Claude Sonnet 4.542#261

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=neuralcad-edit-valid-output-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.