SaaSBench (Engineering) - Data Capability: leaderboard

The Data capability dimension of SaaSBench (Ren et al., 2026), pooled over all 30 SaaS systems a coding agent builds from scratch: whether persistent state is modeled and reachable: tables, keys, storage, import and export. Share of the validation-node score earned in that dimension, in percent; higher is better.

Metric: Capability score (%; share of the Data (schema, storage, import/export) validation-node max score earned across all 30 tasks, pass@1; agent builds and deploys an enterprise SaaS system from a PRD). Source: arxiv.org. Saturation forecast: Around 2031. 16 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.714.57#75
2GLM-5.112.88#175
3MiniMax-M2.711.92#519
4Kimi K2.611.29#173
5Gemini 3.1 Pro (Preview)10.84#91
6DeepSeek V4 Pro10.36#181
7GPT-5.4 (xHigh)9.27#121 (GPT-5.4)
8Qwen 3.6 Plus8.48#217

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=saasbench-engineering-data-capability · How It Works · Data refreshed daily, snapshot 2026-11-12.