BC-Bench - Bug Fixing (pass^5): leaderboard
Consistency view of BC-Bench bug fixing in the AL language of Business Central: the percent of the 101 tasks that a harness and model resolve in all five independent runs; higher is better.
Metric: pass^5 (%; share of tasks resolved in all five runs; bug fixing: a task is resolved when the patch builds and every evaluation test passes; 101 manually curated Business Central (AL) tasks from two Microsoft production repositories; five independent runs per task, 30-minute timeout, agents see the AL code as plain text without the development environment; benchmark version as recorded per configuration (0.1.0 to 0.2.2)). Source: arxiv.org. Saturation forecast: Around May 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 49.5 | #102 |
| 2 | Claude Opus 4.5 | 31.7 | #156 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=bc-bench-bug-fixing-pass-pow-5 · How It Works · Data refreshed daily, snapshot 2026-11-13.