CodeLlama-7B-Instruct-hf: benchmark results

Meta's CodeLlama 7B Instruct, the instruction-tuned code model in the Llama 2-based CodeLlama family, released under the Llama 2 Community License; the linked card provides no further details here. Provider: Meta. Released 2023-08-24. Access: Open.

Aggregate Rating 1243 ± 12, rank #1545 of 1656 rated models, from 101 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ToolBench - The Cat API94Task Score89.5
ToolBench - VirtualHome21.95Task Score79.1
MMLU-by-task - Econometrics32.46Accuracy (%)77.1
MMLU-by-task - Abstract Algebra33Accuracy (%)75.6
ToolBench - Google Sheets41.27Task Score69.8
Enkrypt AI - Safety Risk22.88Risk Score68.9
ToolBench - Open Weather90Task Score67.4
CIPHER - Neutral Prompts71.3Vulnerability rate (% of 750 generations with at least one v66.7
CIPHER - Secure Prompts72.8Vulnerability rate (% of 750 generations with at least one v66.7
ToolBench Leaderboard50.48Average Task Score65.1
MMLU-by-task - Machine Learning34.82Accuracy (%)60.8
ToolBench - Home Search78Task Score60.5

Interactive version: theaggregate.ai/model?slug=codellama-7b-instruct-hf · How It Works · Data refreshed daily, snapshot 2026-10-20.