TravelEval - Intercity Time Deviation: leaderboard

Metric: Intercity Traffic Deviation (ITD): relative deviation of planned from actual intercity travel time (ratio, 0 is exact); Direct prompting (one pass, no tools), plans simulated in the TravelEval sandbox of 10 Chinese cities (real rail, flight, hotel and attraction data, queuing-time model, road-network distances) over 1,150 queries; lower is better. Source: arxiv.org. Saturation forecast: Around January 2027. 7 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.50.14
2DeepSeek V3.1 (Non-reasoning)0.14
3GPT-5 Chat0.16
4Gemini 2.0 Flash0.17
5GPT-4o (2024-11-20)0.19
6GPT-4o Mini (2024-07-18)0.32
7Qwen 3 8B0.33

Interactive version: theaggregate.ai/benchmark?slug=traveleval-intercity-time-deviation · How It Works · Data refreshed daily, snapshot 2026-09-29.