MageBench Season 1: leaderboard
Magic: The Gathering matches between LLM agents on the XMage rules engine (28,000+ cards), 1v1 duels and multiplayer Commander, ranked by Elo; Season 1, run by Gregor Stocks, was won by Gemini 3 Pro.
Metric: Rating (imported). Source: github.com. Source: benchmarklist.com. 34 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 (Medium) | 1747 | #63 (Claude Opus 4.6) |
| 2 | GPT-5.2 (Medium) | 1737 | #110 (GPT-5.2) |
| 3 | DeepSeek V3.2 | 1682 | #205 |
| 4 | GPT-5.4 (Medium) | 1658 | #79 (GPT-5.4) |
| 5 | Gemini 3 Flash (Medium) | 1622 | #99 (Gemini 3 Flash) |
| 6 | O3 (Medium) | 1609 | #124 (O3) |
| 7 | Gemini 3.1 Pro (Preview) (Medium) | 1602 | #58 (Gemini 3.1 Pro (Preview)) |
| 8 | Qwen 3 Coder 480B A35B | 1601 | #279 |
| 9 | Qwen 3 235B A22B | 1594 | #313 |
| 10 | Llama 4 Maverick | 1590 | #464 |
| 11 | Gemini 3.1 Flash Lite | 1578 | #191 |
| 12 | Gemini 2.5 Flash (Medium) | 1572 | #245 (Gemini 2.5 Flash) |
| 13 | Mistral Medium 3.1 | 1569 | #408 |
| 14 | Kimi K2 0905 | 1558 | #288 |
| 15 | Gemini 2.5 Pro (Medium) | 1540 | #152 (Gemini 2.5 Pro) |
Interactive version: theaggregate.ai/benchmark?slug=magebench-season-1 · How It Works · Data refreshed daily, snapshot 2026-10-20.