LongJudgeBench - RealDeepResearch: leaderboard
Metric: Judge accuracy (%) on RealDeepResearch (640 expert-annotated Chinese and English deep-research reports in DOCX form, pointwise): agreement of the LLM judge's pairwise preferences (from pointwise scores, pairwise choices or listwise ranks) or correctness labels with the human reference judgments, averaged within query groups, temperature 0, direct judging with no rubric or reference; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GLM-5.1 | 50.67 |
| 2 | Kimi K2.6 | 44.92 |
| 3 | DeepSeek V4 Flash | 44.27 |
| 4 | Qwen 3 Max | 42.75 |
| 5 | Qwen 3 32B (Thinking) | 41.44 |
| 6 | Qwen 3 32B (Non-reasoning) | 39.29 |
| 7 | GPT-5.2 | 35.54 |
| 8 | GPT-4o Mini | 35.44 |
Interactive version: theaggregate.ai/benchmark?slug=longjudgebench-realdeepresearch · How It Works · Data refreshed daily, snapshot 2026-09-29.