MEGA-Bench Task - Chess Winner Identification — leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro86.7
2GPT-4o66.7
3InternVL2-8B53.3
4InternVL3-38B53.3
5Claude 3.5 Sonnet (20241022)53.3
6Gemini 1.5 Pro (002)53.3
7InternVL2.5-2B53.3
8Qwen 2 VL 72B46.7
9InternVL3-14B46.7
10MiniCPM-V-2.646.7
11GPT-4o Mini46.7
12Claude 3.5 Sonnet (20240620)46.7
13Llama 4 Scout Base46.7
14Gemma 3 12B (IT)40
15Gemma 3 4B (IT)40

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-chess-winner-identification · How the rankings work · Data refreshed daily, snapshot 2026-07-22.