JudgeBench Reasoning: leaderboard

JudgeBench reasoning slice evaluates judge-model accuracy on reasoning comparisons from LiveBench-style tasks.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 52 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.696.94#104
2Qwen 3.5 35B A3B96.94#256
3DeepSeek V3.2 Speciale96.94#128
4Gemini 3.1 Pro (Preview)96.43#58
5GPT-5.596.43#31
6Qwen 3.5 397B A17B95.92#146
7GPT-5 Mini95.41#186
8MiMo-V2-Flash95.41#372
9Qwen 3.5 9B94.9#379
10Qwen 3.6 Plus94.9#120
11Qwen 3.5 122B A10B94.9#173
12Qwen 3.5 4B94.9#475
13GLM-5 FP894.9#143
14Kimi K2.594.39#144
15Kimi K2 (Thinking)94.39#243 (Kimi K2)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=judgebench-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-20.