TFRBench - Bitbrains Fast Storage - Logic-to-Number Consistency: leaderboard
Metric: Mean LLM-judge score (1-5) for logic-to-number consistency of the model's chain-of-thought forecasting reasoning on the TFRBench hourly Bitbrains fast-storage workload, two channels (GIFT-Eval, web/cloud operations) windows, judged by Gemini 3 Pro against the benchmark's verified reference reasoning (w/ Reasoning setting: the model reasons step by step from the history window, then forecasts; no tools; mean of three runs); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Pro | 4.88 |
| 2 | Gemini 2.5 Pro | 3.85 |
| 3 | Gemini 2.5 Flash | 3.15 |
| 4 | Claude Sonnet 4.5 | 2.51 |
| 5 | Claude Sonnet 4 | 1.99 |
Interactive version: theaggregate.ai/benchmark?slug=tfrbench-bitbrains-fast-storage-logic-to-number-consistency · How It Works · Data refreshed daily, snapshot 2026-10-07.