LLaMA-65B: benchmark results

Meta's LLaMA 65B, the original (v1) LLaMA base model at 65B parameters, mirrored here in Hugging Face Transformers format under Meta's non-commercial research license. Provider: Meta. Released 2023-02-24. Access: Open.

Aggregate Rating 1379 ± 16, rank #1303 of 1656 rated models, from 108 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ToolBench - WebShop Short41.2Task Score100
HELM90.83Mean win rate (imported)98.5
HELM Classic - IMDB96.2Exact Match (%)98.5
HELM Classic - NarrativeQA75.49F1 (%)98.5
HELM Classic - NaturalQuestions Closed Book43.14F1 (%)98.5
HELM Classic - WikiFact42.08Exact Match (%)98.5
HELM Classic - MMLU58.37Exact Match (%)97
HELM Classic - bAbI67.66Exact Match (%)95.7
HELM Classic - BoolQ87.1Exact Match (%)92.4
HELM Classic - CivilComments65.46Exact Match (%)92.4
HELM Classic - TruthfulQA50.76Exact Match (%)92.4
HELM Classic - GSM8K46.6Exact Match (%)91.2

Interactive version: theaggregate.ai/model?slug=llama-65b · How It Works · Data refreshed daily, snapshot 2026-10-20.