APIFlow-Bench 1.0 - Statefulness: leaderboard

Postman's APIFlow-Bench 1.0 pass rate on the tasks that exercise the statefulness capability axis, across all task lengths (arXiv 2608.29128v1). Passed over all trials, 0-100 to one decimal, higher is better; refusals and abstentions count as failures. From the live leaderboard's axis page in its all-tasks view.

Metric: Pass Rate (%). Source: www.postman.com. Saturation forecast: Not forecast. 24 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K393.9#35
2Claude Sonnet 4.692.4#94
3Claude Sonnet 592.1#65
4Claude Opus 4.891.8#39
5Qwen 3.6 Plus91.3#124
6DeepSeek V4 Flash90.8#155
7Kimi K2.690.5#113
8MiniMax-M2.790.3#270
9Kimi K2.7 Code90.3#95
10Claude Haiku 4.5 (20251001)90#264
11Kimi K2.589.7#152
12GPT-5.6 Sol89.7#22
13GPT-5.6 Luna89.7#79
14GPT-5.589.5#33
15DeepSeek V4 Pro88.9#112

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=apiflow-bench-1-0-statefulness · How It Works · Data refreshed daily, snapshot 2026-11-05.