ATP-Bench - Encyclopedia: leaderboard

Metric: Final Score (0-100) assigned by the Chief Judge of a Gemini 2.5 Pro multi-agent judging system to the model's interleaved text-and-tool-call answer, on the 966 Encyclopedia queries; zero-shot, tool calls planned but not executed; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 483.69#194
2Grok 4.1 Fast (Reasoning)82.96#208 (Grok 4.1 Fast)
3Claude Sonnet 4.582.39#138
4GPT-581.27#91
5Qwen 2.5 VL 72B Instruct81.11#364
6Gemini 3 Pro78.2#77
7GPT-4o73.59#333
8Llama 3.2 11B40.94#1183

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=atp-bench-encyclopedia · How It Works · Data refreshed daily, snapshot 2026-10-11.