MEGA-Bench Task - Long String Letter Recognition: leaderboard

The "Long String Letter Recognition" subtask of MEGA-Bench Task. A single task from MEGA-Bench, a large-scale multimodal evaluation suite that scores vision-language models across 500+ real-world tasks spanning perception, reasoning, OCR, charts, documents, and multi-image understanding.

Metric: Task Score (%). Source: huggingface.co. Saturation forecast: Not forecast. 44 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro (Preview 03-25)21.4#123
2Qwen 2 VL 2B21.4#1220
3Gemini 2.0 Flash (Preview)21.4#370
4Llama 4 Scout Base21.4#707
5Gemma 3 27B (IT)14.3#523
6InternVL3-78B14.3#352
7MiniCPM-V-2.614.3#836
8Qwen 2 VL 7B14.3#750
9Gemma 3 12B (IT)7.1#664
10InternVL3-8B7.1#620
11Gemini 1.5 Pro (002)7.1#349
12InternVL3-38B7.1#405
13InternVL3-14B7.1#505
14Qwen 2 VL 72B7.1#460
15GPT-4o0#343

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-long-string-letter-recognition · How It Works · Data refreshed daily, snapshot 2026-10-20.