CodeLlama-34B-Python-hf: benchmark results

Provider: Meta. Released 2023-08-24. Access: Open.

Unified ELO 1323 ± 1, rank #1315 of 1392 rated models, from 73 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ToolBench - Home Search91Task Score95.3
ToolBench - Trip Booking85.83Task Score90.7
ToolBench - Google Sheets55.87Task Score88.4
ToolBench Leaderboard59.16Average Task Score86
ToolBench - Tabletop33.33Task Score79.1
ToolBench - Open Weather91.11Task Score76.7
ToolBench - The Cat API88.42Task Score76.7
ToolBench - WebShop Short6.47Task Score74.4
MMLU-by-task - Machine Learning37.5Accuracy (%)71.9
MMLU-by-task - Formal Logic34.92Accuracy (%)69.2
ToolBench - VirtualHome21.24Task Score65.1
MMLU-by-task - Elementary Mathematics31.48Accuracy (%)63.7

Interactive version: theaggregate.ai/model?slug=codellama-34b-python-hf · How It Works · Data refreshed daily, snapshot 2026-09-05.