CodeLlama-7B: benchmark results

Provider: Meta.

Aggregate Rating 1250 ± 40, rank #9256 of 10916 rated models, from 16 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BizBench - FinCode10.7Accuracy (%; 121 CFA and CPA exam questions answered by gene53.3
BizBench - CodeFinQA34Accuracy (%; 844 FinQA questions over report text and tables46.7
BizBench - CodeTAT-QA70.9Accuracy (%; 392 TAT-QA table questions answered by generati46.7
BizBench52.1Mean accuracy (%) over the eight BizBench tasks (FinKnow, Fo35.7
EvalPlus (HumanEval+ & MBPP+)41.1Pass@1 avg (%)34.7
BizBench - FormulaEval52Accuracy (%; 50 financial-formula functions to complete from33.3
BizBench - ConvFinQA Extract82.4Accuracy (%; 916 ConvFinQA questions answerable by extractin20
BizBench - SEC-Num53.1Accuracy (%; 2,000 SEC 10-K and 10-Q filing snippets, extrac20
BizBench - TAT-QA Extract77.4Accuracy (%; 248 TAT-QA questions answerable by extracting a20
BigCode Models Leaderboard30HumanEval Python Pass@1 (%)18.6
Big Code Memorization - HumanEval pass@5022.11HumanEval pass@50 (%)5.9
Big Code Memorization - HumanEval-ET pass@5018.32HumanEval-ET pass@50 (%)5.9

Interactive version: theaggregate.ai/model?slug=codellama-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.