LLM-SoccerArena - Brier Score: leaderboard
Metric: Brier score (0 to 2, lower is better; unscaled three-class Brier score of the home, draw and away probabilities against the 90-minute result, mean over the 104 matches of the 2026 FIFA World Cup; forecasts made 24 hours before kickoff under the probabilistic prompting strategy, averaged over the open-book and closed-book conditions). Source: arxiv.org. Saturation forecast: Around July 2028. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 0.51 |
| 2 | GPT-5.5 | 0.52 |
| 3 | DeepSeek V4 Pro | 0.52 |
| 4 | Grok 4.3 | 0.52 |
| 5 | Qwen 3.7 Max | 0.53 |
| 6 | Claude Opus 4.8 | 0.53 |
| 7 | Mistral Large 3 | 0.55 |
Interactive version: theaggregate.ai/benchmark?slug=llm-soccerarena-brier-score · How It Works · Data refreshed daily, snapshot 2026-09-29.