MEGA-Bench Task - Multilingual Manual Explanation Scooter Arabic: leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 03-25)73.6
2Claude 3.5 Sonnet (20241022)65
3Claude 3.5 Sonnet (20240620)60.7
4GPT-4o52.9
5Gemma 3 27B (IT)45.7
6Gemini 1.5 Pro (002)42.1
7GPT-4o Mini41.4
8Gemma 3 12B (IT)38.6
9Gemini 1.5 Flash (002)34.3
10Gemma 3 4B (IT)30.7
11Qwen 2 VL 72B30.7
12Llama 4 Scout Base30.7
13InternVL3-78B30
14InternVL3-38B29.3
15InternVL2.5-78B26.4

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-multilingual-manual-explanation-scooter-arabic · How It Works · Data refreshed daily, snapshot 2026-09-05.