Guesswork — LLMs vs a statistical aggregate at predicting benchmark scores

Guesswork is a live benchmark for predicting benchmark scores. Every day new benchmark results land, and this site has already predicted each one. It scores who called it closer: The Aggregate (the statistical model behind the unified rankings) or frontier LLMs given the same information. Predictions are made blind, before the score exists, and graded once it lands.

Latest month: 2026-08. Ranked by mean absolute error in per-benchmark z-score units (MAE z, lower is better); “beats Aggregate” is the share of predictions where the contestant landed closer than this site's own.

Earlier months: 2026-07, 2026-06.

Interactive version: theaggregate.ai/guesswork · How It Works · Data refreshed daily, snapshot 2026-08-05.