AgentEscapeBench - Difficulty 20: leaderboard

Escape-room style tool use from AgentEscapeBench (Guo et al., 2026): 60 generated puzzles whose hidden dependency graph has 20 tool and item nodes, which an agent must uncover by inspecting entities and calling real functions such as hashing, decoding and archive tools before submitting a verifiable final flag. Success rate in percent, one run per instance at temperature 0.7; higher is better.

Metric: Success rate (%; share of the 60 difficulty-20 instances (dependency DAGs of 20 tool and item nodes) whose deterministic final flag the agent submits; single run per instance, official APIs at temperature 0.7, multi-turn tool calling with incremental disclosure of hidden nodes). Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.671#100
2Gemini 3.1 Pro (Preview)60#91
3GPT-5.453.3#121
4Kimi K2.531.7#252
5GPT-520#163
6Gemini 3 Flash (Preview)18.3#141
7Seed 2.0 Pro15#209
8MiniMax-M25#669

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=agentescapebench-difficulty-20 · How It Works · Data refreshed daily, snapshot 2026-11-12.