CodeLlama-34B-hf: benchmark results

Meta's CodeLlama 34B, the base code model in the Llama 2-based CodeLlama family, released under the Llama 2 Community License; the linked card provides no further details here. Provider: Meta. Released 2023-08-24. Access: Open.

Aggregate Rating 1274 ± 11, rank #1515 of 1656 rated models, from 98 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ToolBench - Google Sheets64.29Task Score100
ToolBench - VirtualHome24.65Task Score95.3
ToolBench - Tabletop51.32Task Score93
ToolBench - Trip Booking88.33Task Score93
ToolBench Leaderboard62.94Average Task Score93
ToolBench - Home Search88Task Score90.7
ToolBench - Open Weather96.39Task Score88.4
MMLU-by-task - Abstract Algebra34Accuracy (%)82
ToolBench - WebShop Short5.53Task Score72.1
MMLU-by-task - High School Physics33.11Accuracy (%)70.8
MMLU-by-task - College Chemistry39Accuracy (%)70.3
MMLU-by-task - College Mathematics34Accuracy (%)69.2

Interactive version: theaggregate.ai/model?slug=codellama-34b-hf · How It Works · Data refreshed daily, snapshot 2026-10-20.