MathArena - BrokenArXiv March (Allow Disproving): leaderboard
Metric: Binary classification accuracy (%) over 112 statements, the original true statement and its perturbed false version for each of the 56 problems of the March 2026 BrokenArXiv set (plausible statements from recent arXiv papers perturbed to be false), MathArena's provider-recommended settings, no tools, with a prompt that allows disproving and asks whether each statement is true or false (chance 50); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 71 |
| 2 | Step 3.5 Flash | 46.7 |
Interactive version: theaggregate.ai/benchmark?slug=matharena-brokenarxiv-march-allow-disproving · How It Works · Data refreshed daily, snapshot 2026-10-07.