MTGBench - Answer Only - English - Situation Puzzles - Normalized Score: leaderboard
MTGBench Answer Only protocol in English, Situation Puzzles: speed/survival-normalized score among completed episodes. Seven multi-turn puzzle games measure deduction, planning, information gathering and consistency. Incomplete/missing episodes follow the native exclusion policy; completed sample sizes and exact prompt/native-reasoning modes are retained. Overall equally averages seven game means.
Metric: Normalized Score among completed episodes (%). Source: github.com. Saturation forecast: Rough model projection: around 2026. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | qwen3-235b-a22b-instruct-2507 (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 53.58 | |
| 2 | gpt-5.4 (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 47.95 | |
| 3 | gpt-4.1 (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 47.58 | |
| 4 | deepseek-v4-flash (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 46.89 | |
| 5 | deepseek-v4-pro (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 46.53 | |
| 6 | gemini-3-flash-preview (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 42.68 | |
| 7 | gpt-5.4-mini (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 39.89 | |
| 8 | gemini-3.1-flash-lite (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 34.47 | |
| 9 | deepseek-v3.1-terminus (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 33.74 | |
| 10 | qwen3.5-35b-a3b (MTGBench Run: mode=answer_only;effort=unreported;release=ffe4adc59146) | 26.53 |
Interactive version: theaggregate.ai/benchmark?slug=mtgbench-answer-only-english-situation-puzzles-normalized-score · How It Works · Data refreshed daily, snapshot 2026-11-05.