Claude 3 Sonnet: benchmark results

Anthropic's Claude 3 Sonnet, the mid-tier model in the Claude 3 family (alongside Opus and Haiku), balancing cost and capability for large-scale deployments. Provider: Anthropic. Released 2024-03-04. Access: API.

Aggregate Rating 1502 ± 10, rank #775 of 1656 rated models, from 467 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SAD - Identity Leverage72.68Score (%, higher is better)100
SAD - Identity Leverage (Situating Prompt)78.46Score (%, higher is better)100
ShoppingMMLU72.58Average Score (%)100
OpenVLM MMMU - Computer Science70Accuracy (%)89.4
OpenVLM MMT-Bench - Interactive Segmentation57.1Score (%)87.6
OpenVLM MMMU - Finance66.7Accuracy (%)84.3
OpenVLM MMMU - Music40Accuracy (%)84.1
CZ-EVAL - Critical Thinking68.89Accuracy (%)81.8
CZ-EVAL - Klokan (Math)44.28Accuracy (%)81.8
OpenVLM MMT-Bench - Counting By Reasoning85Score (%)81.3
SAD - Mini61Score (%, higher is better)80
Situational Awareness Dataset (SAD)47.19Score (%, higher is better)80

Interactive version: theaggregate.ai/model?slug=claude-3-sonnet · How It Works · Data refreshed daily, snapshot 2026-10-20.