MEGA-Bench Task - Autorater Motion Guided Editing: leaderboard

The "Autorater Motion Guided Editing" subtask of MEGA-Bench Task. A single task from MEGA-Bench, a large-scale multimodal evaluation suite that scores vision-language models across 500+ real-world tasks spanning perception, reasoning, OCR, charts, documents, and multi-image understanding.

Metric: Task Score (%). Source: huggingface.co. Saturation forecast: Not forecast. 44 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro (Preview 03-25)57.1#123
2Claude 3.5 Sonnet (20240620)35.7#299
3InternVL3-78B35.7#352
4Claude 3.5 Sonnet (20241022)28.6#291
5InternVL2-8B21.4#817
6Qwen 2 VL 7B14.3#750
7GLM-4.1V-9B (Thinking)14.3#472 (GLM-4.1V-9B)
8Gemini 2.0 Flash (Preview)14.3#370
9Llama 4 Scout Base14.3#707
10GPT-4o7.1#343
11Gemma 3 4B (IT)7.1#992
12MiniCPM-V-2.67.1#836
13Qwen 2 VL 2B7.1#1220
14Gemma 3 27B (IT)0#523
15Gemma 3 12B (IT)0#664

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-autorater-motion-guided-editing · How It Works · Data refreshed daily, snapshot 2026-10-20.