CLEM TextMapWorld SpecificRoom: leaderboard

CLEM text release v3.0: models navigate toward a specified room. Scores combine protocol-valid play and conditional task quality, higher is better. Headline preserves the native published product of macro-average played percentage and macro-average conditional quality; per-game scores multiply source-published played and quality components without extra rounding. Source temperature, player configuration and exact evidenced model/checkpoint settings are retained. Undefined conditional quality remains missing rather than imputed zero.

Metric: Game Clemscore (%), text v3.0; published played × quality / 100. Source: huggingface.co. Saturation forecast: Estimated already saturated. 31 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.1 70B Instruct100#561
2Gemini 3 Flash (Preview)100#82
3Kimi K2 (Thinking)100#243 (Kimi K2)
4GLM-4.6100#252
5GPT-5.2 (High)100#110 (GPT-5.2)
6GPT-5.2 (Medium)100#110 (GPT-5.2)
7GLM-5 (Non-reasoning)100#141 (GLM-5)
8Qwen 2.5 72B Instruct96.67#454
9DeepSeek V3.296.67#205
10Mistral Large 396.67#401
11GLM-4.796.67#192
12Qwen 3 Max96.67#208
13DeepSeek V3.2 (Non-reasoning)96.67#205 (DeepSeek V3.2)
14Qwen 3 Next 80B A3B Instruct93.33#368
15MiniMax-M2.593.33#303

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=clem-textmapworld-specificroom · How It Works · Data refreshed daily, snapshot 2026-10-20.