SynopticBench: leaderboard
Metric: LLM-judge score (0-1, Gemini-2.5-Flash judge) of a generated weather forecast discussion against the National Weather Service area forecast discussion, from forecast-chart images over North America, 2024-2025 test years; higher is better. Source: arxiv.org. Saturation forecast: Around November 2027. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 0.42 |
Interactive version: theaggregate.ai/benchmark?slug=synopticbench · How It Works · Data refreshed daily, snapshot 2026-10-07.