AdvancedMathBench - VerifierBench Rough: leaderboard
The rough score of VerifierBench in AdvancedMathBench (Shanghai AI Laboratory, 2026): balanced F1 in percent of the valid or invalid verdicts alone on 888 expert-labelled proof trajectories, without checking the rationale. Higher is better.
Metric: Rough balanced F1 (%): binary proof-validity verdicts only, 888 model-generated proof trajectories with expert labels; balanced F1 is the harmonic mean of the true positive and true negative rates; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.5 (xHigh) | 76 | #49 (GPT-5.5) |
| 2 | GPT-5.5 (High) | 76 | #49 (GPT-5.5) |
| 3 | DeepSeek V4 Pro (Max) | 74.1 | #188 (DeepSeek V4 Pro) |
| 4 | GLM-5.2 (Max) | 73.9 | #138 (GLM-5.2) |
| 5 | Qwen 3.5 397B A17B | 68.9 | #246 |
| 6 | GPT-5.2 (xHigh) | 65.9 | #176 (GPT-5.2) |
| 7 | Gemini 3.1 Pro (Preview) (High) | 64.4 | #94 (Gemini 3.1 Pro (Preview)) |
| 8 | Claude Opus 4.8 (Max) | 54.4 | #56 (Claude Opus 4.8) |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=advancedmathbench-verifierbench-rough · How It Works · Data refreshed daily, snapshot 2026-11-13.