MTGBench - Prompted CoT - Russian - 20 Questions - Win Rate: leaderboard
MTGBench Prompted CoT protocol in Russian, 20 Questions: win rate among completed episodes. Seven multi-turn puzzle games measure deduction, planning, information gathering and consistency. Incomplete/missing episodes follow the native exclusion policy; completed sample sizes and exact prompt/native-reasoning modes are retained. Overall equally averages seven game means.
Metric: Win Rate among completed episodes (%). Source: github.com. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | gpt-4.1 (MTGBench Run: mode=cot;effort=unreported;release=ffe4adc59146) | 42 | |
| 2 | qwen3-235b-a22b-instruct-2507 (MTGBench Run: mode=cot;effort=unreported;release=ffe4adc59146) | 37 | |
| 3 | qwen3-30b-a3b-instruct-2507 (MTGBench Run: mode=cot;effort=unreported;release=ffe4adc59146) | 31 |
Interactive version: theaggregate.ai/benchmark?slug=mtgbench-prompted-cot-russian-20-questions-win-rate · How It Works · Data refreshed daily, snapshot 2026-11-05.