Beyond Rating: leaderboard
Beyond Rating (2026) evaluates AI peer reviewers on the text of their reviews: generated reviews of ICLR and NeurIPS papers are split into atomic points and matched by Qwen3-235B against filtered high-confidence human reviews. This board is weakness Max-Recall in percent, the share of one human reviewer's weakness points the generated review covers, taking the best-covered reviewer per paper; higher is better.
Metric: Weakness Max-Recall (from 0-1, times 100): share of a single human reviewer's weakness points that the generated review's weakness points cover, taking the best-covered reviewer per paper, on 1,000 test papers from ICLR 2024-2026 and NeurIPS 2022-2025 with three to five high-confidence human reviews each, the model writing a full review from the parsed paper; review points are split into atomic claims and matched to the human reviews' claims by Qwen3-235B; higher is better. Source: arxiv.org. Saturation forecast: Around February 2028. 15 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 46 | #261 |
| 2 | GPT-5.2 | 42 | #185 |
| 3 | AgentReview + GPT-5 | 40 | |
| 4 | AI Scientist + GPT-5 | 38 | |
| 5 | DeepSeek V3.2 | 36 | #419 |
| 6 | Qwen 3 235B A22B 2507 Instruct | 32 | #616 |
| 7 | DeepReviewer-14B | 31 | #844 |
| 8 | Qwen 3 30B A3B 2507 Instruct | 29 | #1100 |
| 9 | Gemini 3 Pro (Preview) | 28 | #119 |
| 10 | SEA-E-7B | 26 | |
| 11 | Qwen 3 8B | 25 | #1873 |
| 12 | CycleReviewer-70B | 20 | #1880 |
| 13 | OpenReviewer-8B | 19 | |
| 14 | Llama 3.1 8B Instruct | 16 | #4600 |
| 15 | Llama 3.1 70B Instruct | 16 | #1571 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=beyond-rating · How It Works · Data refreshed daily, snapshot 2026-11-21.