RefereeBench - Foul and Penalty Classification: leaderboard

Metric: Accuracy (%) on foul and penalty classification questions (mean of Q2 and Q4), averaged across 11 sports; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 11 models tracked.

Top models

#ModelScore
1Gemini 3 Flash58.8
2Gemini 3 Pro57.9
3GPT-556.6
4Seed 1.853.4
5GPT-4o47.1
6Claude Sonnet 4.545.4
7Claude Haiku 4.535.4

Interactive version: theaggregate.ai/benchmark?slug=refereebench-foul-and-penalty-classification · How It Works · Data refreshed daily, snapshot 2026-10-07.