CodeLlama-7B-Python: benchmark results

Provider: Meta.

Aggregate Rating 1278 ± 43, rank #8999 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ENAMEL24.7Greedy eff@1 (%) (imported)55.2
BigCode Models Leaderboard40.5HumanEval Python Pass@1 (%)44.1
EvoEval Subtle42Pass@1 (%)34
EvoEval Verbose43.9Pass@1 (%)34
EvoEval Tool Use44Pass@1 (%)32
Big Code Memorization - HumanEval pass@138.41HumanEval pass@1 (%)29.4
Big Code Memorization - HumanEval pass@5030.62HumanEval pass@50 (%)29.4
Big Code Memorization - HumanEval-ET pass@133.54HumanEval-ET pass@1 (%)29.4
Big Code Memorization - HumanEval-ET pass@5025.68HumanEval-ET pass@50 (%)29.4
CRUXEval35.9Output Prediction pass@1 (%)28.6
EvoEval Concise36.59Pass@1 (%)25
EvoEval29.27Pass@1 (%)24

Interactive version: theaggregate.ai/model?slug=codellama-7b-python · How It Works · Data refreshed daily, snapshot 2026-11-08.