Ironbee Raw Code Review - Frontier - RECALL: leaderboard
Ironbee raw code review (2026): standalone model review of real pull requests, three repeated runs. Full uses 50 PRs and Frontier 10 PRs; no cohort pooling. Model-specific requested tiers remain explicit; precision, recall, F1 and F2 are separate metrics. Aggregated source fractions are multiplied by 100, with full precision retained. RECALL (%).
Metric: RECALL (%). Source: raw.githubusercontent.com. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Ironbee Study claude-fable-5.1 - low tier | 77.52 | |
| 2 | Ironbee Study claude-fable-5.1 - xhigh tier | 77.52 | |
| 3 | Ironbee Study claude-fable-5.1 - default tier | 73.64 | |
| 4 | Ironbee Study gpt-6-astra - xhigh tier | 42.64 | |
| 5 | Ironbee Study gpt-6-astra - default tier | 40.31 | |
| 6 | Ironbee Study gpt-6-astra - low tier | 38.76 |
Interactive version: theaggregate.ai/benchmark?slug=ironbee-raw-code-review-frontier-recall · How It Works · Data refreshed daily, snapshot 2026-10-21.