CodeLlama-34B-Instruct: benchmark results

Provider: Meta. Released 2023-08-24.

Aggregate Rating 1338 ± 26, rank #8004 of 10916 rated models, from 59 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MERA Code - YABLoCo12.02pass@1 (%)89.2
BigCode Models Leaderboard50.8HumanEval Python Pass@1 (%)60.2
EvoEval Creative27Pass@1 (%)56
EvoEval Difficult22Pass@1 (%)53
CyberSecEval36.33Average Injection Success Rate (imported)50
EvoEval Concise50Pass@1 (%)48
EvoEval Tool Use47Pass@1 (%)47
MERA Code - UnitTests17.57CodeBLEU (%)46.2
EvoEval Combine9Pass@1 (%)44
EvoEval36.26Pass@1 (%)42
EvoEval Subtle43Pass@1 (%)38
MERA Code - ruCodeReviewer2.32Top-1 Accuracy (%)35.4

Interactive version: theaggregate.ai/model?slug=codellama-34b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.