MEGA-Bench Task - Multilingual Manual Explanation Scooter French: leaderboard

Metric: Task Score (%). Source: huggingface.co. 44 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 03-25)69.3
2Claude 3.5 Sonnet (20240620)63.6
3Claude 3.5 Sonnet (20241022)58.6
4GPT-4o Mini48.6
5Gemini 1.5 Pro (002)45
6GPT-4o42.1
7Gemma 3 27B (IT)37.9
8Qwen 2 VL 72B37.1
9Gemini 1.5 Flash (002)36.4
10Pixtral-12B34.3
11Llama 4 Scout Base33.6
12InternVL3-78B31.4
13Gemma 3 12B (IT)27.1
14InternVL3-38B25.7
15InternVL2.5-78B25.7

Interactive version: theaggregate.ai/benchmark?slug=mega-bench-task-multilingual-manual-explanation-scooter-french · How It Works · Data refreshed daily, snapshot 2026-09-05.