CodeLlama-34B: benchmark results

Provider: Meta.

Aggregate Rating 1356 ± 35, rank #7545 of 10916 rated models, from 16 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BizBench62.5Mean accuracy (%) over the eight BizBench tasks (FinKnow, Fo71.4
BizBench - CodeFinQA52.4Accuracy (%; 844 FinQA questions over report text and tables66.7
BizBench - CodeTAT-QA81.4Accuracy (%; 392 TAT-QA table questions answered by generati66.7
BizBench - FinCode17.4Accuracy (%; 121 CFA and CPA exam questions answered by gene66.7
BizBench - FormulaEval70Accuracy (%; 50 financial-formula functions to complete from66.7
BizBench - SEC-Num67Accuracy (%; 2,000 SEC 10-K and 10-Q filing snippets, extrac66.7
Big Code Memorization - HumanEval-ET pass@141.46HumanEval-ET pass@1 (%)58.8
Big Code Memorization - HumanEval pass@148.17HumanEval pass@1 (%)55.9
BizBench - ConvFinQA Extract88.1Accuracy (%; 916 ConvFinQA questions answerable by extractin53.3
BizBench - TAT-QA Extract83.9Accuracy (%; 248 TAT-QA questions answerable by extracting a53.3
Big Code Memorization - HumanEval pass@5034.78HumanEval pass@50 (%)52.9
Big Code Memorization - HumanEval-ET pass@5029.06HumanEval-ET pass@50 (%)52.9

Interactive version: theaggregate.ai/model?slug=codellama-34b · How It Works · Data refreshed daily, snapshot 2026-11-08.