CADWorld: leaderboard

Metric: Task success rate (%; 200 long-horizon FreeCAD tasks in 11 workflow categories; the agent acts on 1920x1080 screenshots through GUI actions for at most 100 steps; success only when every task-specific executable check on the saved .FCStd artifact and auxiliary outputs passes). Source: arxiv.org. Saturation forecast: Around April 2028. 7 models tracked.

Top models

#ModelScore
1GPT-5.4 (Medium)17.5
2Claude Opus 4.8 (Medium)16
3Kimi K2.6 (Non-reasoning)7.5
4Qwen 3.6 35B A3B (Non-reasoning)0

Interactive version: theaggregate.ai/benchmark?slug=cadworld · How It Works · Data refreshed daily, snapshot 2026-09-26.