DeepSeek-Coder-V2-Instruct-0724: benchmark results

Provider: DeepSeek. Access: Open.

Aggregate Rating 1585 ± 48, rank #1103 of 10556 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MERA Code - YABLoCo14.9pass@1 (%)100
MERA Code - RealCodeJava38.59pass@1 (%)95.4
MERA Code - JavaTestGen26.87pass@1 (%)76.9
MERA Code0.35Total score73.8
MERA Code - RealCode36.41pass@1 (%)73.8
MERA Code - ruCodeEval43.29pass@1 (%)69.2
MERA Code - ruHumanEval39.21pass@1 (%)66.2
MERA Code - ruCodeReviewer5.95Top-1 Accuracy (%)60
MERA Code - CodeLinterEval49.36pass@1 (%)52.3
MERA Code - CodeCorrectness71.42Accuracy (%)49.2
MERA Code - UnitTests18.79CodeBLEU (%)49.2
BigO(Bench) - Time Complexity Generation3.3all@1 (%)43.3

Interactive version: theaggregate.ai/model?slug=deepseek-coder-v2-instruct-0724 · How It Works · Data refreshed daily, snapshot 2026-11-17.