ArXivMath August 2026 No Tools (Anthropic Internal Harness): leaderboard

Accuracy on MathArena's August 2026 set of 57 research-mathematics problems, averaged over four attempts per problem in Anthropic's internal harness without safeguard classifiers. No tools. Distinct from MathArena's two-attempt vendor-harness leaderboard and earlier monthly sets.

Metric: Accuracy (%). Source: www-cdn.anthropic.com. Saturation forecast: Around January 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.5 (Max)91.2#3 (Claude Opus 5.5)
2Claude Sonnet 5.5 (Max)86.8#10 (Claude Sonnet 5.5)
3Claude Opus 5.5 (xHigh)86#3 (Claude Opus 5.5)
4Claude Fable 5.1 (Max)82.9#9 (Claude Fable 5.1)
5Claude Fable 5.1 (xHigh)82.5#9 (Claude Fable 5.1)
6Claude Opus 5 (Max)78.1#12 (Claude Opus 5)
7Claude Opus 5 (xHigh)75.4#12 (Claude Opus 5)
8Claude Opus 5.5 (High)73.2#3 (Claude Opus 5.5)
9Claude Fable 5.1 (High)73.2#9 (Claude Fable 5.1)
10Claude Opus 5 (High)71.5#12 (Claude Opus 5)
11Claude Opus 5 (Medium)67.5#12 (Claude Opus 5)
12Claude Fable 5.1 (Medium)67.1#9 (Claude Fable 5.1)
13Claude Opus 5.5 (Medium)64#3 (Claude Opus 5.5)
14Claude Fable 5.1 (Low)50.9#9 (Claude Fable 5.1)
15Claude Opus 5 (Low)36#12 (Claude Opus 5)

No result here: #5 GPT-6 Astra, #7 Gemini 4 Argon, #8 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=arxivmath-august-2026-no-tools-anthropic-internal-harness · How It Works · Data refreshed daily, snapshot 2026-10-16.