IF-RewardBench - Overall Assessment: leaderboard

Metric: Kendall tau-b (-1 to 1) between the judge ranking of the responses to each instruction (about seven) and the human-verified preference graph, averaged over IF-RewardBench's three instruction types (842 instructions); general LLMs compare every response pair (pairwise prompt, Elo aggregation), reward models score each response; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash0.51#93
2GPT-5 Mini0.46#176
3DeepSeek V3.20.29#198
4GLM-4.6 (Thinking)0.27#246 (GLM-4.6)
5QwQ-32B0.18#410
6GLM 4.5 Air (Thinking)0.15#377 (GLM 4.5 Air)
7Qwen 3 32B (Thinking)0.13#424 (Qwen 3 32B)
8Llama 3.3 70B Instruct0.05#520
9Qwen 2.5 72B Instruct0.05#436

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=if-rewardbench-overall-assessment · How It Works · Data refreshed daily, snapshot 2026-10-11.