MEGA-Bench Task - Autorater Unmask — leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1GPT-4o71.4
2InternVL3-38B71.4
3Claude 3.5 Sonnet (20241022)71.4
4Gemini 2.5 Pro64.3
5Gemini 1.5 Pro (002)57.1
6Gemini 1.5 Flash (002)57.1
7Gemini 2.0 Flash (Preview)57.1
8Qwen 2 VL 72B50
9Aquila-VL-2B42.9
10GPT-4o Mini42.9
11Claude 3.5 Sonnet (20240620)42.9
12Gemma 3 27B (IT)35.7
13Gemma 3 4B (IT)35.7
14MiniCPM-V-2.635.7
15InternVL3-78B28.6

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-autorater-unmask · How the rankings work · Data refreshed daily, snapshot 2026-07-22.