Llama 2 7B: benchmark results

Meta's Llama 2 7B, the base pretrained checkpoint released under the Llama 2 Community License in July 2023; the linked model card provides no further details here. Provider: Meta. Released 2023-07-18. Access: Open.

Aggregate Rating 1269 ± 10, rank #1520 of 1656 rated models, from 196 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SAD - Predict Words61.22Self-prediction score (%, higher is better)100
SAD - Predict Words (Situating Prompt)57.89Self-prediction score (%, higher is better)100
SAD - Introspection37.95Score (%, higher is better)90
SAD - Introspection (Situating Prompt)37.32Score (%, higher is better)90
HELM Classic - Synthetic Reasoning Natural26.02F1 (%)82.4
HELM Classic - bAbI54.97Exact Match (%)81.9
HELM Classic - QuAC40.62F1 (%)80
ToolBench - WebShop Short6.92Task Score79.1
HELM Classic - WikiFact33.49Exact Match (%)75.8
HELM Classic - Dyck65.8Exact Match (%)75
HELM Classic - Entity Matching85.07Exact Match (%)74.2
HELM Classic - MATH Chain-of-Thought9.91Equivalent (%)72.1

Interactive version: theaggregate.ai/model?slug=llama-2-7b · How It Works · Data refreshed daily, snapshot 2026-10-20.