FWBench: leaderboard
Metric: Decision score S (lower is better; 0 is the hindsight-optimal plan bought with no forecast credits; per case S is half the sum of the excess decision loss over the perfect-demand plan, scaled by the hour-of-day policy's mean excess loss, and the forecast credits spent over the budget of 113,726; invalid plans take a loss penalty above every feasible loss; averaged by series and lead and weighted over electricity seasons and cycle hire; 1,251 cases: 1,091 EIA-930 electricity and 160 TfL cycle-hire, 12 tool calls per case, forecasts from Chronos-Bolt Tiny, Chronos-2 and TimesFM 2.5). Source: arxiv.org. Saturation forecast: Around September 2028. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-6 (High) | 0.4 |
| 2 | GPT-5.4 Nano (High) | 2.64 |
Interactive version: theaggregate.ai/benchmark?slug=fwbench · How It Works · Data refreshed daily, snapshot 2026-09-26.