Claude 3 Haiku (20240307) — benchmark results

March 7, 2024 Claude 3 Haiku snapshot, tracked separately from generic Claude 3 Haiku rows. Provider: Anthropic. Released 2024-03-07. Access: API.

Unified ELO 1447 ± 17, rank #1012 of 1776 rated models, from 105 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM Safety Anthropic Red Team100LM Evaluated Safety score (%)100
LogicKor - Grammar8.07Score (0-10)92.5
BiGGen-Bench3.95Average Score (1-5)92.2
LogicKor - Understanding9.64Score (0-10)90.7
LogicKor - Multi-Turn8.35Score (0-10)88.1
LogicKor8.26Score (0-10)87.2
LogicKor - Reasoning8.07Score (0-10)87.2
LogicKor - Single-Turn8.4Score (0-10)87.2
HELM Safety SimpleSafetyTests100LM Evaluated Safety score (%)86
LogicKor - Coding9.28Score (0-10)85.8
LogicKor - Math7.07Score (0-10)85
LiveBench Summarize69.58Score84.7

Interactive version: theaggregate.ai/model?slug=claude-3-haiku-20240307 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.