MEGA-Bench Task - Video Short Title: leaderboard

The "Video Short Title" subtask of MEGA-Bench Task. A single task from MEGA-Bench, a large-scale multimodal evaluation suite that scores vision-language models across 500+ real-world tasks spanning perception, reasoning, OCR, charts, documents, and multi-image understanding.

Metric: Task Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 44 models tracked.

Top models

#ModelScoreOverall rank
1Claude 3.5 Sonnet (20241022)81.4#291
2Claude 3.5 Sonnet (20240620)75#299
3Gemini 2.5 Pro (Preview 03-25)74.3#123
4GPT-4o73.6#343
5Gemma 3 12B (IT)70.7#664
6InternVL3-38B69.3#405
7Gemini 2.0 Flash (Preview)69.3#370
8InternVL3-14B68.6#505
9Gemma 3 27B (IT)67.9#523
10InternVL3-78B67.9#352
11InternVL2.5-78B67.1#431
12Gemini 1.5 Flash (002)66.4#583
13Qwen 2 VL 72B65.7#460
14Pixtral-12B65#808
15GPT-4o Mini64.3#599

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-video-short-title · How It Works · Data refreshed daily, snapshot 2026-10-20.