BehaviorBench - Beauty Contest Win Rate: leaderboard

Metric: Win rate (%) in the beauty contest game played against recorded human players: share of sessions in which the guess of the model is closer to two thirds of the group average than every human guess; higher is better. Source: arxiv.org. Saturation forecast: Around 2038. 18 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.617
2GPT-4.117
3Claude Opus 4.615
4DeepSeek V3.214
5Gemini 3.1 Flash Lite (Preview)14
6Claude Haiku 4.513
7Gemini 3.1 Pro (Preview)12
8GPT-5.4 Mini (High)10
9Qwen 3 4B9
10GPT-5.4 (High)8
11Llama 3.3 70B Instruct6

Interactive version: theaggregate.ai/benchmark?slug=behaviorbench-beauty-contest-win-rate · How It Works · Data refreshed daily, snapshot 2026-09-29.