Qwen2.5-Coder-0.5B-Instruct: benchmark results

Provider: Alibaba.

Aggregate Rating 1277 ± 41, rank #9003 of 10916 rated models, from 8 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LintEval - Pass@148.8Pass@1 (%; share of the 498 LintEval-Lite C++/Python/Java pr38.5
Delulu - Edit Similarity62.5Edit similarity (0-100): character-level normalized Levensht25
Delulu0.44pass@120
Delulu - Exact Match22.8Exact match (%) of the completion with the gold completion, 20
Wolfram LLM Benchmarking Project9.1Correct Functionality (%)4.4
Aider Code Editing Leaderboard14.3Exercises completed correctly after one retry, pass_rate_2 (0
Delulu - CodeBLEU36CodeBLEU (0-100): n-gram, syntax-tree and dataflow agreement0
LintEval - Reduction@P-1.2Reduction@P (%; corpus-level net reduction of the original l0

Interactive version: theaggregate.ai/model?slug=qwen2-5-coder-0-5b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.