deepseek-coder-6.7B-base: benchmark results

Provider: DeepSeek. Released 2023-11-02. Access: Open.

Unified ELO 1319 ± 1, rank #1327 of 1392 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ShaderMatch17.51Clone Match Rate (%)95.2
SAFIM63.4Average92.9
EffiBench - NMU1.91Normalized Memory Usage58.5
EffiBench - NET2.98Normalized Execution Time51.2
EvalPlus (HumanEval+ & MBPP+)49.2Pass@1 avg (%)42.7
GSM8K21.3Accuracy (%)22.6
ARC Challenge (AI2)36.4Accuracy (%)14.5
MMLU36.4Accuracy (%)8.9
WinoGrande57.6Accuracy (%)7.5

Interactive version: theaggregate.ai/model?slug=deepseek-coder-6-7b-base · How It Works · Data refreshed daily, snapshot 2026-09-05.