StructureClaw (Automatic Workflow): leaderboard

StructureClaw executable agent benchmark (arXiv 2607.14896); the automatic-workflow track reports the success rate of building a working structured-extraction agent without human guidance.

Metric: Success Rate (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.297.3#73
2GPT-5.591.3#31
3Qwen 3.7 Max89.3#75
4Gemini 3.5 Flash88.7#60
5Claude Opus 4.886.7#37
6DeepSeek V4 Flash83.3#137
7DeepSeek V4 Pro81.3#102
8Kimi K2.678#104
9MiniMax-M350#136

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=structureclaw-automatic-workflow · How It Works · Data refreshed daily, snapshot 2026-10-20.