DTap-Bench (Benign Tasks) - Travel: leaderboard

Benign travel booking tasks from DTap-Bench (Chen et al., 2026), run by a tool-using agent in simulated MCP environments with no attack applied. Success rate in percent over 130 tasks, averaged over task categories and judged by a rule-based check of the final environment state; higher is better.

Metric: Benign task success rate (%; 130 benign travel booking tasks, no attack applied; a task succeeds when a rule-based check of the final environment state finds the instruction fully completed; mean of its task-category rates). Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro99.4#135
2GPT-5.295.3#172
3DeepSeek V4 Pro95.1#181
4GPT-5.490.6#121
5GPT-5.189.2#225
6GPT-5.586.1#48
7Claude Sonnet 4.556.7#244
8GPT-OSS-120B0#699

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=dtap-bench-benign-tasks-travel · How It Works · Data refreshed daily, snapshot 2026-11-12.