CodeLlama-34B-Python: benchmark results

Provider: Meta.

Aggregate Rating 1362 ± 51, rank #7373 of 10916 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BigCode Models Leaderboard53.3HumanEval Python Pass@1 (%)69.5
ENAMEL26.8Greedy eff@1 (%) (imported)65.5
CRUXEval41.4Output Prediction pass@1 (%)50
EvoEval Combine11Pass@1 (%)50
EvoEval Subtle47Pass@1 (%)48
EvoEval Concise49.39Pass@1 (%)46
EvoEval Creative24Pass@1 (%)46
EvoEval35.61Pass@1 (%)40
EvoEval Tool Use44Pass@1 (%)32
EvoEval Verbose42.07Pass@1 (%)32
EvoEval Difficult15Pass@1 (%)28

Interactive version: theaggregate.ai/model?slug=codellama-34b-python · How It Works · Data refreshed daily, snapshot 2026-11-08.