ControBench - Trump: leaderboard

ControBench (Ta Thanh Thuy et al., 2026) asks a model to infer a Reddit user's stance from the user's posts, comments and the comments they replied to, with labels taken from self-declared community flairs. This board is the two-class Trump topic (supporter or non-supporter, from r/AskTrumpSupporters). Models are prompted one-shot at temperature 0 on a stratified 200-user sample, and the score is Macro-F1 in percent; higher is better.

Metric: Macro-F1 (%; 2-class user stance, one-shot prompting on a stratified 200-user sample). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K289.46#435
2Qwen 3 235B A22B 2507 (Thinking)87.48#460
3DeepSeek R187.47#467
4DeepSeek V3 (0324)85.93#704
5Qwen 3 235B A22B84.45#622
6GPT-4o Mini74.97#1627
7Llama 3.1 8B Instruct65.24#4277

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=controbench-trump · How It Works · Data refreshed daily, snapshot 2026-11-12.