BALROG BabyAI (VLM) — leaderboard

Metric: Progress (%). Source: balrogai.com. 10 models tracked.

Top models

#ModelScore
1Human Expert98
2Median Human95
3Claude 3.5 Sonnet (20241022)82
4Gemini 2.5 Pro (03-25)74
5Llama 3.2 90B Instruct66
6GPT-4o (2024-05-13)62
7Gemini 1.5 Pro (002)58.4
8Gemini 1.5 Flash (002)43.2
9GPT-4o Mini (2024-07-18)38
10Llama 3.2 11B Instruct18

Interactive version: theaggregate.ai/benchmark?slug=balrog-babyai-vlm · How the rankings work · Data refreshed daily, snapshot 2026-07-22.