BizAgentBench - Intermediate Failure: leaderboard
BizAgentBench / BizBench (2026), 50 long-horizon banking tasks with deterministic final-state and trajectory requirements, revised customer simulator protocol. Claude Opus 5 and Muse Spark 1.3 have one run per task; other models have three, averaged. Goal attainment, process compliance, protected constraints and joint strict success are distinct outcomes; intermediate failure is failure of process or protection. Rate (%); lower is better.
Metric: Rate (%). Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 4 | #12 |
| 2 | GPT-6 Sol | 5.3 | #14 |
| 3 | Muse Spark 1.3 | 6 | #24 |
| 4 | DeepSeek V4.1 Flash | 9.3 | #36 |
| 5 | DeepSeek V4 Pro | 24.7 | #102 |
| 6 | Qwen 3.8 27B | 28 | #105 |
| 7 | GLM-5.3 Flash | 29.3 | #65 |
| 8 | DeepSeek V4 Flash | 47.3 | #137 |
| 9 | Qwen 3.5 397B A17B | 56.7 | #146 |
| 10 | Qwen 3.5 9B | 83.3 | #379 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=bizagentbench-intermediate-failure · How It Works · Data refreshed daily, snapshot 2026-10-20.