CLEM Wordle with Critic: leaderboard

CLEM text release v3.0: models guess a hidden word with a critic interaction. Scores combine protocol-valid play and conditional task quality, higher is better. Headline preserves the native published product of macro-average played percentage and macro-average conditional quality; per-game scores multiply source-published played and quality components without extra rounding. Source temperature, player configuration and exact evidenced model/checkpoint settings are retained. Undefined conditional quality remains missing rather than imputed zero.

Metric: Game Clemscore (%), text v3.0; published played × quality / 100. Source: huggingface.co. Saturation forecast: Around January 2027. 30 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash (Preview)73.89#82
2GPT-5.2 (High)70.28#110 (GPT-5.2)
3DeepSeek V3.268.33#205
4GPT-5.2 (Medium)66.67#110 (GPT-5.2)
5Kimi K2 (Thinking)54.83#243 (Kimi K2)
6Qwen 3 Max53.89#208
7GPT-OSS-120B50.39#341
8DeepSeek V3.2 (Non-reasoning)49.72#205 (DeepSeek V3.2)
9GLM-5 (Non-reasoning)43.33#141 (GLM-5)
10Kimi K2.5 (Non-reasoning)38.34#144 (Kimi K2.5)
11Qwen 3 Next 80B A3B Instruct36.11#368
12GLM-4.735#192
13GPT-OSS-20B34.16#518
14Llama 3.3 70B Instruct27.22#534
15GLM-4.625.28#252

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=clem-wordle-with-critic · How It Works · Data refreshed daily, snapshot 2026-10-20.