MEGA-Bench Task - Chess Syzygy Endgames: leaderboard

The "Chess Syzygy Endgames" subtask of MEGA-Bench Task. A single task from MEGA-Bench, a large-scale multimodal evaluation suite that scores vision-language models across 500+ real-world tasks spanning perception, reasoning, OCR, charts, documents, and multi-image understanding.

Metric: Task Score (%). Source: huggingface.co. Saturation forecast: Around 2030. 44 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro (Preview 03-25)20.5#123
2Claude 3.5 Sonnet (20241022)18.6#291
3Gemini 2.0 Flash (Preview)15.7#370
4GPT-4o15#343
5Gemma 3 12B (IT)10.3#664
6InternVL3-8B10#620
7GLM-4.1V-9B (Thinking)9.9#472 (GLM-4.1V-9B)
8Claude 3.5 Sonnet (20240620)9.7#299
9Gemini 1.5 Pro (002)9.6#349
10Qwen 2 VL 2B9.5#1220
11Gemma 3 27B (IT)8.3#523
12Qwen 2 VL 72B7.7#460
13Gemini 1.5 Flash (002)7.6#583
14InternVL3-38B7.1#405
15InternVL3-78B7.1#352

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-chess-syzygy-endgames · How It Works · Data refreshed daily, snapshot 2026-10-20.