OpenRouter Tau2-Bench Airline: leaderboard

OpenRouter's own τ²-Bench Airline run: 50 multi-turn airline customer-service tasks where the model must use tools and follow policy, executed against the production endpoints it serves.

Metric: Accuracy (%). Source: openrouter.ai. Saturation forecast: Around February 2027. 142 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.180#145
2Claude Fable 579.5#20
3Ling 3.1 Flash79.3#75
4Claude Fable 5.179.2#10
5Claude Opus 578.8#16
6Claude Sonnet 5.578.8#14
7Gemini 4 Argon78.7#9
8Qwen 3.5 397B A17B78.4#154
9Gemini 3.7 Flash78.3#24
10Gemini 3.5 Flash Lite78.3#174
11MiMo-V2.6-Flash77.9#74
12Qwen 3.8 27B77.5#123
13DeepSeek V4 Pro (0813)77.5#58
14GLM-5.377.3#44
15Qwen 3.5 122B A10B77.2#184

Interactive version: theaggregate.ai/benchmark?slug=openrouter-tau2-bench-airline · How It Works · Data refreshed daily, snapshot 2026-11-05.