JudgeBench Coding: leaderboard

JudgeBench coding slice evaluates judge-model accuracy on code-answer comparisons.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 52 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)97.62#58
2GPT-5.597.62#31
3Kimi K2.597.62#144
4GPT-5 Mini97.62#186
5Gemma 4 31B (IT)97.62#176
6Kimi K2.697.62#104
7Qwen 3.5 35B A3B97.62#256
8DeepSeek R1 052897.62#222
9Step 3.5 Flash97.62#270
10DeepSeek V3.2 Speciale97.62#128
11GLM-4.7 FP897.62#209
12GLM-5 FP897.62#143
13GLM-5.1 FP897.62#109
14GPT-OSS-20B96.43#518
15GPT-OSS-120B95.24#341

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=judgebench-coding · How It Works · Data refreshed daily, snapshot 2026-10-20.