CLEM Wordle with Clue: leaderboard

CLEM text release v3.0: models guess a hidden word using an additional clue. Scores combine protocol-valid play and conditional task quality, higher is better. Headline preserves the native published product of macro-average played percentage and macro-average conditional quality; per-game scores multiply source-published played and quality components without extra rounding. Source temperature, player configuration and exact evidenced model/checkpoint settings are retained. Undefined conditional quality remains missing rather than imputed zero.

Metric: Game Clemscore (%), text v3.0; published played × quality / 100. Source: huggingface.co. Saturation forecast: Around January 2027. 31 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash (Preview)80.11#82
2GPT-5.2 (High)77.5#110 (GPT-5.2)
3GPT-5.2 (Medium)76.39#110 (GPT-5.2)
4Kimi K2 (Thinking)70.11#243 (Kimi K2)
5GLM-4.767.5#192
6GPT-OSS-120B62.5#341
7DeepSeek V3.262.23#205
8MiniMax-M2.559.44#303
9GLM-4.655.39#252
10GLM-5 (Non-reasoning)55.28#141 (GLM-5)
11Kimi K2.5 (Non-reasoning)54.83#144 (Kimi K2.5)
12DeepSeek V3.2 (Non-reasoning)53.94#205 (DeepSeek V3.2)
13Qwen 3 Max52.5#208
14Qwen 3 Next 80B A3B Instruct47.78#368
15GPT-OSS-20B41.33#518

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=clem-wordle-with-clue · How It Works · Data refreshed daily, snapshot 2026-10-20.