CLEM Taboo: leaderboard

CLEM text release v3.0: models describe and guess words while avoiding forbidden clues. Scores combine protocol-valid play and conditional task quality, higher is better. Headline preserves the native published product of macro-average played percentage and macro-average conditional quality; per-game scores multiply source-published played and quality components without extra rounding. Source temperature, player configuration and exact evidenced model/checkpoint settings are retained. Undefined conditional quality remains missing rather than imputed zero.

Metric: Game Clemscore (%), text v3.0; published played × quality / 100. Source: huggingface.co. Saturation forecast: Estimated already saturated. 31 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.2 (High)98.33#110 (GPT-5.2)
2GPT-5.2 (Medium)95.83#110 (GPT-5.2)
3Gemini 3 Flash (Preview)95.56#82
4GLM-4.785.83#192
5Kimi K2 (Thinking)81.39#243 (Kimi K2)
6DeepSeek V3.279.16#205
7GPT-OSS-120B77.77#341
8Mistral Large 376.67#401
9Qwen 3 Max76.67#208
10Kimi K2.5 (Non-reasoning)75.84#144 (Kimi K2.5)
11GLM-5 (Non-reasoning)75.83#141 (GLM-5)
12MiniMax-M2.573.61#303
13GLM-4.671.11#252
14DeepSeek V3.2 (Non-reasoning)66.39#205 (DeepSeek V3.2)
15Llama 3.1 70B Instruct64.16#561

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=clem-taboo · How It Works · Data refreshed daily, snapshot 2026-10-20.