SupraBench - Top-Binder Selection: leaderboard

Metric: Accuracy (%) at picking the strongest of four candidate guests for a host (2,264 questions), zero-shot direct prompt. Source: arxiv.org. Saturation forecast: Around April 2028. 8 models tracked.

Top models

#ModelScore
1Gemini 3 Flash49.8
2GPT-5.4 Mini42.8
3GPT-5.4 Nano41.1
4Qwen 3.5 27B40.4
5Qwen 3.5 9B37.9
6Llama 3.1 70B Instruct33.8
7Llama 3.1 8B Instruct22.8

Interactive version: theaggregate.ai/benchmark?slug=suprabench-top-binder-selection · How It Works · Data refreshed daily, snapshot 2026-09-29.