RPCBench - Error Group - Boundary-Violating Premise - Conditional Localization: leaderboard

Metric: Localization Accuracy (%). Source: github.com. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScore
1Qwen 3.5 Plus97.4
2Qwen 3.5 397B A17B96.82
3GPT-5.595.5
4Claude Sonnet 4.695.42
5Gemini 3.1 Pro (Preview)94.31
6Qwen 3.5 122B A10B93.75
7Qwen 3.5 35B A3B93.03
8DeepSeek V4 Flash83.42
9DeepSeek V4 Pro83.33
10Llama 3.1 70B Instruct81.29
11Llama 3.1 8B Instruct59.45

Interactive version: theaggregate.ai/benchmark?slug=rpcbench-error-group-boundary-violating-premise-conditional-localization · How It Works · Data refreshed daily, snapshot 2026-09-24.