ForecastBench-Sim Pandemic - Vaccine Conditional: leaderboard
Metric: Brier Score (0-1; scored responses). Source: raw.githubusercontent.com. 16 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4.1 | 0.02 |
| 2 | Claude Sonnet 4.5 | 0.04 |
| 3 | Llama 3.1 70B Instruct | 0.04 |
| 4 | GPT-5 Mini | 0.04 |
| 5 | GPT-5.1 | 0.05 |
| 6 | GPT-5 Nano | 0.07 |
| 7 | O3 Mini (2025-01-31) | 0.07 |
| 8 | DeepSeek V3 | 0.07 |
| 9 | Qwen 2.5 72B Instruct | 0.08 |
| 10 | GPT-5 | 0.09 |
| 11 | O3 (2025-04-16) | 0.1 |
| 12 | Claude Haiku 4.5 (20251001) | 0.1 |
| 13 | Gemini 2.5 Pro | 0.13 |
| 14 | O4 Mini (2025-04-16) | 0.15 |
| 15 | Grok 4 | 0.19 |
Interactive version: theaggregate.ai/benchmark?slug=forecastbench-sim-pandemic-vaccine-conditional · How It Works · Data refreshed daily, snapshot 2026-09-19.