TravelEval - Cost Calculation Deviation: leaderboard
TravelEval (KDD 2026) asks an LLM for a complete multi-day travel plan and simulates it in a sandbox of 10 Chinese cities with real transport, hotel and attraction data. Scores are from Direct prompting over 1,150 queries. The board is the summed error of the itemised cost arithmetic in the plan divided by the true total cost, a ratio where 0 is exact; lower is better.
Metric: Cost Calculation Deviation (CCD): summed absolute error of the plan's itemised costs over the actual total cost (ratio, 0 is exact); Direct prompting (one pass, no tools), plans simulated in the TravelEval sandbox of 10 Chinese cities (real rail, flight, hotel and attraction data, queuing-time model, road-network distances) over 1,150 queries; lower is better. Source: arxiv.org. Saturation forecast: Around December 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 0.07 | #250 |
| 2 | GPT-5 Chat | 0.1 | #444 |
| 3 | DeepSeek V3.1 (Non-reasoning) | 0.13 | #497 (DeepSeek V3.1) |
| 4 | Gemini 2.0 Flash | 0.14 | #704 |
| 5 | GPT-4o (2024-11-20) | 0.14 | #866 |
| 6 | Qwen 3 8B | 0.19 | #1830 |
| 7 | GPT-4o Mini (2024-07-18) | 0.28 | #1510 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=traveleval-cost-calculation-deviation · How It Works · Data refreshed daily, snapshot 2026-11-13.