Claude Opus 4.1 (Thinking): benchmark results

Claude Opus 4.1 evaluated with thinking enabled. Provider: Anthropic. Released 2025-08-05. Access: API.

Aggregate Rating 1690 ± 15, rank #390 of 2168 rated models, from 110 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Nejumi 4 - JTruthfulQA78.01Score (%)100
SuperCLUE General (September 2025) - Hallucination Control85.23Score100
Nejumi 4 - Toxicity - Violation Categories61.11Criteria met (%)99.3
Nejumi 4 - BFCL - Multi-Turn66.67Accuracy (%)99
BenchTable82.7Total Score (%)98.8
BenchTable - Reasoning90.4Weighted Score (%)98.8
BenchTable - STEM89.6Weighted Score (%)98.8
BenchTable - Tech93.9Weighted Score (%)98.8
AA MMLU-Pro87.99Accuracy (%)98.3
Nejumi 4 - MT-Bench (Japanese) - Extraction99Judge rating (1-10, x10)98.3
Nejumi 4 - jaster (0-shot) - ALT English-to-Japanese92.58COMET wmt22 (x100)98.3
Nejumi 4 - jaster (2-shot) - JBLiMP97Exact match (%)98.3

Interactive version: theaggregate.ai/model?slug=claude-opus-4-1-thinking · How It Works · Data refreshed daily, snapshot 2026-10-20.