BC-Bench - Bug Fixing (pass^5): leaderboard
Metric: pass^5 (%; share of tasks resolved in all five runs; bug fixing: a task is resolved when the patch builds and every evaluation test passes; 101 manually curated Business Central (AL) tasks from two Microsoft production repositories; five independent runs per task, 30-minute timeout, agents see the AL code as plain text without the development environment; benchmark version as recorded per configuration (0.1.0 to 0.2.2)). Source: arxiv.org. Saturation forecast: Around November 2027. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.6 | 49.5 |
| 2 | Claude Opus 4.5 | 31.7 |
Interactive version: theaggregate.ai/benchmark?slug=bc-bench-bug-fixing-pass-pow-5 · How It Works · Data refreshed daily, snapshot 2026-09-29.