MEGA-Bench Task - Multilingual Manual Explanation Scooter Arabic — leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro73.6
2Claude 3.5 Sonnet (20241022)65
3Claude 3.5 Sonnet (20240620)60.7
4GPT-4o52.9
5Gemini 2.0 Flash (Preview)49.3
6Gemma 3 27B (IT)45.7
7Gemini 1.5 Pro (002)42.1
8GPT-4o Mini41.4
9Gemma 3 12B (IT)38.6
10Gemini 1.5 Flash (002)34.3
11Gemma 3 4B (IT)30.7
12Qwen 2 VL 72B30.7
13Llama 4 Scout Base30.7
14InternVL3-78B30
15InternVL3-38B29.3

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-multilingual-manual-explanation-scooter-arabic · How the rankings work · Data refreshed daily, snapshot 2026-07-22.