TFRBench - NYC Taxi - Logic-to-Number Consistency: leaderboard
Metric: Mean LLM-judge score (1-5) for logic-to-number consistency of the model's chain-of-thought forecasting reasoning on the TFRBench hourly NYC taxi demand (transportation) windows, judged by Gemini 3 Pro against the benchmark's verified reference reasoning (w/ Reasoning setting: the model reasons step by step from the history window, then forecasts; no tools; mean of three runs); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Pro | 4.87 |
| 2 | Gemini 2.5 Pro | 4.36 |
| 3 | Gemini 2.5 Flash | 4.33 |
| 4 | Claude Sonnet 4 | 2.87 |
| 5 | Claude Sonnet 4.5 | 2.77 |
Interactive version: theaggregate.ai/benchmark?slug=tfrbench-nyc-taxi-logic-to-number-consistency · How It Works · Data refreshed daily, snapshot 2026-10-07.