RPCBench - Proactive Detection: leaderboard

RPCBench tests proactive critique of flawed recommendation premises, locating the premise problem and suggesting a suitable strategy while remaining faithful to the provided evidence. This series reports RPCBench - Proactive Detection from 2609.00918v1, S3.T2: Detection Rate (%). Higher is better.

Metric: Detection Rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)60#66
2Qwen 3.5 122B A10B59.8#186
3GPT-5.559.6#34
4DeepSeek V4 Pro59.3#113
5Qwen 3.5 Plus59.1#136
6Qwen 3.5 397B A17B59#155
7Claude Sonnet 4.658#97
8Qwen 3.5 35B A3B56.5#270
9DeepSeek V4 Flash53.8#156
10Llama 3.1 70B Instruct22.7#570
11Llama 3.1 8B Instruct19.1#1021

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=rpcbench-proactive-detection · How It Works · Data refreshed daily, snapshot 2026-11-07.