Concordat Cooperative Airline - Claude Opus 5.5 paired20: leaderboard

Concordat tests airline-service agents with cooperative and pressure-testing customers. Each result keeps the customer simulation and agent configuration separate. Task success (%).

Metric: Task success (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 2 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.5 (standard agent)95
2Claude Opus 5.5 (Concordat loose confirmation)90

Interactive version: theaggregate.ai/benchmark?slug=concordat-cooperative-airline-claude-opus-5-5-paired20 · How It Works · Data refreshed daily, snapshot 2026-10-29.