HAL TAU-bench Airline — leaderboard

Metric: Accuracy (%). Source: hal.cs.princeton.edu. 26 models tracked.

Top models

#ModelScore
1Claude 3.7 Sonnet (20250219)56
2O4 Mini (High)56
3Claude Opus 4.1 (20250805)54
4O3 (Medium)54
5Claude 3.7 Sonnet (High)52
6Claude Opus 4.1 (High)52
7GPT-5 (Medium)48
8DeepSeek V3 (0324)44
9Claude Opus 4 (20250514)44
10GPT-4.1 (2025-04-14)36
11DeepSeek R136
12O4 Mini (Low)36
13Gemini 2.0 Flash (001)22

Interactive version: theaggregate.ai/benchmark?slug=hal-tau-bench-airline · How the rankings work · Data refreshed daily, snapshot 2026-07-22.