MathArena - ARXIV_FALSE February: leaderboard

MathArena ARXIV_FALSE (February) — spotting fabricated/incorrect claims in arXiv-style math statements; accuracy on the monthly problem set.

Metric: Accuracy (%). Source: matharena.ai. Saturation forecast: Around May 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.5 (xHigh)68.15#31 (GPT-5.5)
2GPT-5.4 (xHigh)37.9#79 (GPT-5.4)
3Claude Opus 4.8 (Max)35.48#37 (Claude Opus 4.8)
4GPT-5.2 (xHigh)25.81#110 (GPT-5.2)
5Gemini 3.1 Pro (Preview)18.55#58
6DeepSeek V4 Flash (Max)17.74#137 (DeepSeek V4 Flash)
7DeepSeek V4 Pro (Max)13.31#102 (DeepSeek V4 Pro)
8Step 3.7 Flash12.1#236
9GLM-511.69#141
10Kimi K2.6 (Thinking)11.69#104 (Kimi K2.6)
11Step 3.5 Flash11.29#270
12GLM-5.210.48#73
13GLM-5.19.27#97
14Gemini 3.5 Flash6.45#60
15Claude Opus 4.7 (xHigh)4.03#49 (Claude Opus 4.7)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=matharena-arxiv-false-february · How It Works · Data refreshed daily, snapshot 2026-10-20.