DeepSeek-Coder-33B-Instruct: benchmark results

Provider: DeepSeek. Access: Open.

Aggregate Rating 1466 ± 27, rank #2996 of 10916 rated models, from 32 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EvoEval Verbose75Pass@1 (%)96
EvoEval60.45Pass@1 (%)94
EvoEval Tool Use66Pass@1 (%)94
BigCode Models Leaderboard80HumanEval Python Pass@1 (%)93.2
EvoEval Combine31Pass@1 (%)92
EvoEval Concise72.56Pass@1 (%)92
EvoEval Difficult47Pass@1 (%)92
CanItEdit (Descriptive)49.78pass@1 (%; share of the 105 hand-written Python editing prob91.7
EvoEval Creative47Pass@1 (%)91
McEval54.3AVG (%)90.5
EvoEval Subtle67Pass@1 (%)90
CodeEditorBench Plus - Code Requirement Switch (Three-shot)23.5pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus88.9

Interactive version: theaggregate.ai/model?slug=deepseek-coder-33b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.