Claude Sonnet 4 (Thinking 16K): benchmark results
Claude Sonnet 4 evaluated with a 16K-token thinking budget. Provider: Anthropic. Released 2025-05-22. Access: API.
Unified ELO 1628 ± 1, rank #329 of 1761 rated models, from 8 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Generalization V1 (Lechmazur) | 1.69 | Avg Rank (lower is better) | 98.8 |
| Confabulation Leaderboard (Lechmazur) | 2.48 | Confabulation rate % (lower is better) | 98.4 |
| NYT Connections Older Models | 26.4 | Score (%) | 68.2 |
| Step Game (Lechmazur) | 3.09 | TrueSkill μ | 68.2 |
| Elimination Game (Lechmazur) | 4.32 | TrueSkill μ | 54.2 |
| WeirdML | 46.11 | Average Score | 52.9 |
| ARC-AGI-2 | 5.93 | Accuracy (%) | 42.8 |
| ARC-AGI-1 | 40 | Accuracy (%) | 34.1 |
Interactive version: theaggregate.ai/model?slug=claude-sonnet-4-thinking-16k · How It Works · Data refreshed daily, snapshot 2026-09-05.