MEGA-Bench Task - Generated Video Artifacts: leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 03-25)49.4
2Pixtral-12B43.8
3GPT-4o Mini43.7
4InternVL3-8B40.6
5Gemma 3 27B (IT)40
6Llama 4 Scout Base40
7Gemma 3 12B (IT)36.9
8Gemini 1.5 Pro (002)36.9
9Gemma 3 4B (IT)36.3
10Gemini 1.5 Flash (002)35.6
11GPT-4o35
12InternVL3-38B33.1
13Claude 3.5 Sonnet (20240620)32.5
14InternVL2-8B31.3
15Qwen 2 VL 7B31.2

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-generated-video-artifacts · How It Works · Data refreshed daily, snapshot 2026-09-05.