Claude 2.1: benchmark results

Anthropic Claude 2.1 legacy chat model. Provider: Anthropic. Released 2023-11-21. Access: API.

Aggregate Rating 1482 ± 11, rank #839 of 1656 rated models, from 149 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
T-Eval78.8Overall Score (%)90
CZ-EVAL - Verbal63.36Accuracy (%)81.8
BenchTable - Utility68.8Weighted Score (%)81.2
HELM Lite - WMT 2014 (cs-en)23.09BLEU-4 (%)77.8
HELM MMLU - Public Relations77.27EM75
CZ-EVAL - Analytical38.04Accuracy (%)72.7
BenchBench66.94Aggregate Score (%)72.1
HELM Lite - LegalBench - Corporate Lobbying81.22Exact Match (%)70
SAD - Facts60.08Score (%, higher is better)70
SAD - Identity Leverage (Situating Prompt)54.12Score (%, higher is better)70
SAD - Self-Recognition62.19Score (%, higher is better)70
HELM MMLU - Global Facts55EM69.2

Interactive version: theaggregate.ai/model?slug=claude-2-1 · How It Works · Data refreshed daily, snapshot 2026-10-20.