CompanionBench - English - Holding Ambiguity: leaderboard

CompanionBench capability score for Holding Ambiguity: tolerating uncertainty, presence without action, space-holding and resisting the righting reflex, averaged over English-condition companionship dialogues by a cross-family LLM judge panel (CompanionBench, arXiv 2608.02046v2, Appendix Table H.1). Mean rubric score on a 1-10 scale; higher is better. Capability means correlate strongly across capabilities.

Metric: Mean judge score (1-10). Source: arxiv.org. Saturation forecast: Around February 2027. 28 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.7 Max8.75#85
2GPT-5.48.58#83
3GPT-5.58.57#33
4DeepSeek V4 Pro8.54#112
5Claude Opus 4.88.54#39
6Qwen 3 235B A22B 2507 Instruct8.52#315
7Kimi K2.68.5#113
8Kimi K2.58.48#152
9Gemma 4 31B (IT)8.45#178
10DeepSeek V4 Flash8.41#155
11Qwen 3.5 122B A10B8.4#184
12Claude Sonnet 4.68.38#94
13GLM-58.37#149
14GLM-5.18.37#109
15GPT-4.18.34#258

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=companionbench-english-holding-ambiguity · How It Works · Data refreshed daily, snapshot 2026-11-05.