Claude Sonnet 4 (Non-reasoning): benchmark results

Claude Sonnet 4 evaluated with reasoning disabled. Provider: Anthropic. Released 2025-05-22. Access: API.

Aggregate Rating 1627 ± 16, rank #615 of 2168 rated models, from 129 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ChronosBench - Complex Scenes (Guided Prompt)72.22Task Completion Rate (%; equal-weight mean of positive and n100
Nejumi 4 - BFCL - Non-Live AST84.07Accuracy (%)98.6
Nejumi 4 - jaster (2-shot) - JSICK86Exact match (%)97.2
Nejumi 4 - HalluLens100Hallucination resistance (%)95.8
Nejumi 4 - MT-Bench (Japanese) - Extraction98.5Judge rating (1-10, x10)95.8
Nejumi 4 - Toxicity - Social Norms99.21Criteria met (%)95.1
UGI - Writing63.68Writing Score93.7
Nejumi 4 - MT-Bench (Japanese) - Math100Judge rating (1-10, x10)89.5
Nejumi 4 - jaster (2-shot) - ALT English-to-Japanese92.6COMET wmt22 (x100)89.5
Nejumi 4 - jaster (0-shot) - ALT English-to-Japanese92.48COMET wmt22 (x100)89.2
UGI - Natural Intelligence51.13NatInt Score88.9
Nejumi 4 - Toxicity - Fairness98.87Criteria met (%)88.5

Interactive version: theaggregate.ai/model?slug=claude-sonnet-4-non-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-20.