Qwen 2.5 Coder 14B Instruct: benchmark results

Alibaba's Apache-2.0 14B code model from the November 2024 Qwen2.5-Coder expansion to six sizes, trained on 5.5T code-heavy tokens with 128K context. Provider: Alibaba. Released 2024-11-12. Access: Open.

Aggregate Rating 1532 ± 12, rank #675 of 1656 rated models, from 91 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
GSM8K94.2Accuracy (%)98.9
Open Korean LLM - Ko-GSM8K (flexible extract)72.18Exact match, flexible extract (%)98.6
Open Korean LLM - Ko-IFEval64Strict accuracy, prompt/instruction mean (%)98
Open Korean LLM Leaderboard49.63Average Score (%)97
Open Ko-LLM Leaderboard49.63Average (%)96.9
Open Japanese LLM - Wiki PAS SET F111.46Score (%)94.7
Open Portuguese LLM - ASSIN2 RTE94.07Macro F1 (%)94.4
Open Korean LLM - Ko-EQ-Bench44.34EQ-Bench score93.5
BigCodeBench48.2Pass@1 (%)92
Delulu - CodeBLEU51.5CodeBLEU (0-100): n-gram, syntax-tree and dataflow agreement90
Open Portuguese LLM - BLUEX66.48Accuracy (%)88.5
Open Korean LLM - KorNAT-Harmless67.14Normalized accuracy (%)88.1

Interactive version: theaggregate.ai/model?slug=qwen-2-5-coder-14b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.