Phind-CodeLlama-34B-Python-v1: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1153 ± 17, rank #9914 of 10916 rated models, from 70 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
InfiBench52.17Score (%)81
BigCode Models Leaderboard70.2HumanEval Python Pass@1 (%)79.7
MMLU-by-task - High School Statistics43.98Accuracy (%)70
MMLU-by-task - Formal Logic34.92Accuracy (%)69.3
MMLU-by-task - College Physics27.45Accuracy (%)63
MMLU-by-task - Moral Scenarios27.26Accuracy (%)59.8
MMLU-by-task - College Chemistry36Accuracy (%)59.4
MMLU-by-task - TruthfulQA MC245.27Accuracy (%)52.7
MMLU-by-task - High School Physics30.46Accuracy (%)50.8
MMLU-by-task - TruthfulQA MC128.15Accuracy (%)49.4
MMLU-by-task - Professional Medicine44.85Accuracy (%)45.7
Open LLM Leaderboard v1 - GSM8K21.53Accuracy (%) (5-shot)42

Interactive version: theaggregate.ai/model?slug=phind-codellama-34b-python-v1 · How It Works · Data refreshed daily, snapshot 2026-11-08.