Llama 3 Chat 70B: benchmark results

Provider: Meta. Released 2024-04-18. Access: Open.

Aggregate Rating 1502 ± 22, rank #773 of 1640 rated models, from 42 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SAD - Self-Recognition (Situating Prompt)73.69Score (%, higher is better)90
SAD - Introspection (Situating Prompt)35.81Score (%, higher is better)85
Enkrypt AI - Jailbreak Risk3.88Risk Score84.4
SAD - Count Tokens (Situating Prompt)13.13Token-count accuracy (%, higher is better)81.8
SAD - Predict Words40.56Self-prediction score (%, higher is better)81.8
SAD - Introspection34.81Score (%, higher is better)80
SAD - Self-Recognition65.69Score (%, higher is better)80
SAD - Stages (Situating Prompt)48.44Score (%, higher is better)80
SAD - Count Tokens11.73Token-count accuracy (%, higher is better)77.3
SAD - Predict Words (Situating Prompt)38.56Self-prediction score (%, higher is better)77.3
SAD - Influence65.31Score (%, higher is better)75
SAD - Mini60.64Score (%, higher is better)75

Interactive version: theaggregate.ai/model?slug=llama-3-chat-70b · How It Works · Data refreshed daily, snapshot 2026-11-07.