GroupTravelBench - Easy: leaderboard
GroupTravelBench Easy reports Group Utility on the 200 easy multi-user travel planning tasks, which allow up to 15 chat rounds (GroupTravelBench, 2026). Group Utility adds points per user for satisfied preferences and subtracts points for violated ones and for splitting the group, so it has no fixed range and can be negative; higher is better.
Metric: Group Utility (GU, unnormalized points per user, unbounded and can be negative: +2 or +1 for each satisfied must or prefer item, -2 or -1 for each violated reject or avoid item, minus K-1 for each split into K subgroups, divided by the group size) on the 200 easy tasks (15 rounds), on GroupTravelBench, multi-user multi-turn group travel planning in a group-chat sandbox with 10 cached travel tools (DeepSeek-V4-Flash user simulator at temperature 0, agent temperature 0.7, mean of 3 trials per task); GPT-5.1 in instruct mode, the other models with reasoning enabled; higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 9 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | DeepSeek V4 Pro | Thinking | 9.46 | #196 |
| 2 | Qwen 3.6 Max (Preview) | Thinking | 8.54 | |
| 3 | Qwen 3.5 Plus | Thinking | 7.57 | #242 |
| 4 | GroupTravelBench Qwen3-235B-A22B-Thinking (checkpoint unspecified) | 6.47 | ||
| 5 | GPT-5.1 | Non-reasoning | 6.35 | #240 |
| 6 | Qwen 3.5 Flash | Thinking | 6.2 | #441 |
| 7 | GroupTravelBench Qwen3-30B-A3B-Thinking (checkpoint unspecified) | 5.27 | ||
| 8 | Qwen 3 4B Instruct | 5.22 | #1696 | |
| 9 | GroupTravelBench Qwen3-4B-Thinking (checkpoint unspecified) | 4.89 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=grouptravelbench-easy · How It Works · Data refreshed daily, snapshot 2026-11-21.