ATP-Bench - Travel: leaderboard

Metric: Final Score (0-100) assigned by the Chief Judge of a Gemini 2.5 Pro multi-agent judging system to the model's interleaved text-and-tool-call answer, on the 734 Travel queries; zero-shot, tool calls planned but not executed; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro73.07#77
2Claude Sonnet 454.77#194
3Claude Sonnet 4.554.56#138
4GPT-549.63#91
5Grok 4.1 Fast (Reasoning)49.18#208 (Grok 4.1 Fast)
6GPT-4o43.94#333
7Qwen 2.5 VL 72B Instruct32.06#364
8Llama 3.2 11B23.64#1183

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=atp-bench-travel · How It Works · Data refreshed daily, snapshot 2026-10-11.