BALROG Official LLM Leaderboard: leaderboard

Official BALROG LLM leaderboard for long-horizon game reasoning across BabyAI, Crafter, BabaIsAI, MiniHack, NetHack, and related game environments.

Metric: % Progress (percentage). Source: github.com. Source: benchmarklist.com. Saturation forecast: Around July 2027. 34 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro58.1#80
2Gemini 3.1 Pro (Preview) (Thinking)57#58 (Gemini 3.1 Pro (Preview))
3Gemini 3.1 Pro (Preview)56.9#58
4Gemini 3 Flash48.1#99
5Grok 443.6#181
6Claude Opus 4.543.5#83
7Gemini 2.5 Pro (Preview 03-25)43.3#123
8Claude Opus 4.5 (Thinking)43#83 (Claude Opus 4.5)
9DeepSeek R134.9#251
10Gemini 2.5 Flash33.5#245
11GPT-5 (Minimal)32.8#98 (GPT-5)
12Claude 3.5 Sonnet (20241022)32.6#291
13GPT-4o (2024-05-13)32.3#325
14Claude Haiku 4.531.2#280
15Grok 329.5#304

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=balrog-official-llm-leaderboard · How It Works · Data refreshed daily, snapshot 2026-10-20.