Claude 3.7 Sonnet: benchmark results

Anthropic's first hybrid-reasoning Sonnet, switching between near-instant replies and extended thinking with an API thinking budget (February 2025). Provider: Anthropic. Released 2025-02-24. Access: API.

Aggregate Rating 1679 ± 4, rank #249 of 1656 rated models, from 1486 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AGC-Bench - riddlesense1.25Dataset z-score100
AgentRewardBench (Accessibility Tree) - AssistantBench87.5Precision (%)100
AgentRewardBench (Accessibility Tree) - WorkArena++66.7Precision (%)100
AgentRewardBench (Screenshot)69.4Precision (%)100
AgentRewardBench (Screenshot) - VisualWebArena64.8Precision (%)100
AgentRewardBench (Screenshot) - WorkArena++66.7Precision (%)100
BehaviorBench (Behavioral Traces) - Belief Confidence Error (ProfileGen)0.08Confidence mean absolute error on a 0 to 1 scale: gap betwee100
CodeGuard64F1 (%; three-way classification of 1,000 manually verified t100
Complexity Ceiling Benchmark31.9Accuracy (%; share of parseable trials whose final answer an100
Complexity Ceiling Benchmark - Symbolic Pointer Tracking71.2Accuracy (%; share of parseable trials whose final answer an100
DARE-bench (Data Science) - Classification (ML Modeling)61.03Macro-F1 (shown times 100) against the ground-truth labels o100
DARE-bench (Data Science) - Regression (ML Modeling)63.2Clipped R-squared (0 to 1, shown times 100) against the grou100

Interactive version: theaggregate.ai/model?slug=claude-3-7-sonnet · How It Works · Data refreshed daily, snapshot 2026-10-20.