COIN-Bench - Breadth: leaderboard

Metric: Breadth score as printed: total weight of the COIN-Tree nodes the questionnaire covers (node weights 1-3 per discussion from upvotes and views, summed when nodes merge; no fixed maximum), for questionnaires the model writes from each product's consumer discussions, matched by sentence embeddings to COIN-Tree, a weighted intent tree that GPT-4o extracted from the same discussions; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 22 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.253.62#105
2Gemini 3 Flash53.51#93
3GPT-553.48#91
4GPT-4.153.41#240
5DeepSeek R1 Distill Qwen 14B53.32#828
6Qwen 3 30B A3B53.2#488
7GPT-4o52.95#333
8Claude 3.5 Sonnet52.83#337
9O352.73#121
10Qwen 2.5 32B Instruct52.46#491
11Qwen 3 32B51.15#424
12Qwen 3 8B50.58#667
13Qwen 2.5 72B Instruct50.52#436
14DeepSeek R1 Distill Qwen 32B50.34#640
15Qwen 2.5 14B Instruct48.27#634

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=coin-bench-breadth · How It Works · Data refreshed daily, snapshot 2026-10-11.