neuralCAD-Edit - Valid Output Rate: leaderboard

Metric: Validity (from 0-1, times 100): share of edits that produce a valid CAD model, on the 192 neuralCAD-Edit requests (expert CAD designers' video, speech, drawing and text edit requests on Autodesk Fusion models), the model editing the input STEP model by writing and re-running CadQuery scripts in the authors' harness with visual inspection; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.

Top models

#ModelScore
1GPT-5.299
2Gemini 3 Pro58
3Claude Sonnet 4.542

Interactive version: theaggregate.ai/benchmark?slug=neuralcad-edit-valid-output-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.