TFRBench - NYC Taxi - Event Relevance: leaderboard
Metric: Mean LLM-judge score (1-5) for event relevance of the model's chain-of-thought forecasting reasoning on the TFRBench hourly NYC taxi demand (transportation) windows, judged by Gemini 3 Pro against the benchmark's verified reference reasoning (w/ Reasoning setting: the model reasons step by step from the history window, then forecasts; no tools; mean of three runs); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.5 | 2.36 |
| 2 | Gemini 3 Pro | 2.11 |
| 3 | Gemini 2.5 Pro | 1.7 |
| 4 | Claude Sonnet 4 | 1.33 |
| 5 | Gemini 2.5 Flash | 1.18 |
Interactive version: theaggregate.ai/benchmark?slug=tfrbench-nyc-taxi-event-relevance · How It Works · Data refreshed daily, snapshot 2026-10-07.