Beyond Rating - Strength Recall: leaderboard

Beyond Rating (2026) evaluates AI peer reviewers on the text of their reviews: generated reviews of ICLR and NeurIPS papers are split into atomic points and matched by Qwen3-235B against filtered high-confidence human reviews. This board is strength Max-Recall in percent, the share of one human reviewer's strength points the generated review covers, taking the best-covered reviewer per paper; higher is better.

Metric: Strength Max-Recall (from 0-1, times 100): share of a single human reviewer's strength points that the generated review's strength points cover, taking the best-covered reviewer per paper, on 1,000 test papers from ICLR 2024-2026 and NeurIPS 2022-2025 with three to five high-confidence human reviews each, the model writing a full review from the parsed paper; review points are split into atomic claims and matched to the human reviews' claims by Qwen3-235B; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 15 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1DeepReviewer-14B61#844
2Qwen 3 30B A3B 2507 Instruct53#1100
3Qwen 3 235B A22B 2507 Instruct53#616
4DeepSeek V3.251#419
5Claude Sonnet 4.548#261
6SEA-E-7B47
7Qwen 3 8B46#1873
8AgentReview + GPT-545
9Gemini 3 Pro (Preview)42#119
10AI Scientist + GPT-542
11Llama 3.1 8B Instruct39#4600
12Llama 3.1 70B Instruct39#1571
13GPT-5.238#185
14OpenReviewer-8B37
15CycleReviewer-70B30#1880

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=beyond-rating-strength-recall · How It Works · Data refreshed daily, snapshot 2026-11-21.