Trip+ - Request Fulfillment: leaderboard

Trip+ (2026) has tool-using LLM agents plan and revise minute-level travel itineraries over multi-turn conversations with profiled travelers, changing requests and environment disruptions, in a fixed travel sandbox. This board is request fulfillment: whether each turn incorporates the new or revised requirements. Scores are on a 0 to 100 scale; higher is better.

Metric: Request fulfillment (0-100), a rate scaled by 100: whether the response incorporates the new or revised constraints, preferences and environment conditions of the turn, averaged over all turns, on multi-turn personalized travel planning with traveler profiles, request changes and environment disruptions, the same OpenAI-compatible function-calling scaffold over a fixed travel sandbox for every model, temperature 0 where supported; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 18 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 31B74.65#394
2Gemini 3.1 Pro (Preview)73.82#94
3GLM-5.172.14#179
4Gemini 3 Flash (Preview)68.85#144
5Seed 2.0 Pro68.11#211
6Kimi K2.667.27#178
7Hy3-preview67.08#316
8DeepSeek V4 Pro66.57#188
9Qwen 3.5 27B (Non-reasoning)63.09#359 (Qwen 3.5 27B)
10Gemma 4 26B A4B59.89#615
11MiniMax-M2.757.66#518
12GPT-5.455.85#123
13DeepSeek V3.254.18#406
14GPT-5.4 Mini48.79#389
15GLM-4 32B46.56#1299

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=trip-plus-request-fulfillment · How It Works · Data refreshed daily, snapshot 2026-11-13.