CMDB-1500 (Text): leaderboard
Surd AI CMDB-1500 fixed-input decision benchmark: accuracy on 1200 text questions spanning candidate choice, yes/no, ordinal and multi-select decisions. The vendor-run leaderboard includes general-purpose LLMs and Surd AI decision models; text and image panels use separate fixed denominators.
Metric: Accuracy (%), fixed denominator of 1,200 questions (invalid answers count as wrong), effort as labelled. Source: surdai.com. Saturation forecast: Around March 2027. 10 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6.1 Sol | Low | 80 | #15 |
| 2 | SPX-CD-Pro | 79.33 | ||
| 3 | Claude Sonnet 5.5 | Low | 78 | #24 |
| 4 | SPX-CD-Flash | 77.58 | ||
| 5 | GPT-6 Luna | Low | 76.58 | #105 |
| 6 | GLM-5.3 Flash | Low | 75.75 | #133 |
| 7 | SPX-CD-Omni | 74.67 | ||
| 8 | Qwen 3.8 Flash | 71.08 | #125 | |
| 9 | Kimi K2.6 | 71 | #192 | |
| 10 | DeepSeek V4.1 Flash | 68.58 | #67 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=cmdb-1500-text · How It Works · Data refreshed daily, snapshot 2026-11-21.