Qwen 2.5 Coder 32B: benchmark results
Alibaba's open Qwen 2.5 Coder 32B, the flagship code model of the Qwen 2.5 Coder series (November 2024). Provider: Alibaba. Released 2024-11-12. Access: Open.
Aggregate Rating 1533 ± 19, rank #667 of 1656 rated models, from 28 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Portuguese LLM - FaQuAD NLI | 83.29 | Macro F1 (%) | 96.6 |
| GSM8K | 91.1 | Accuracy (%) | 94.6 |
| Open LLM Leaderboard - MMLU-Pro | 53.03 | Score | 92.9 |
| Open Portuguese LLM - ASSIN2 RTE | 93.58 | Macro F1 (%) | 90.3 |
| Open LLM Leaderboard - BBH | 64.04 | Score | 88.7 |
| Open LLM Leaderboard - GPQA | 34.65 | Score | 86.7 |
| Open LLM Leaderboard - MuSR | 45.28 | Score | 84.8 |
| Open LLM Leaderboard - MATH Level 5 | 30.89 | Score | 82.4 |
| FormalRewardBench | 37.6 | Pairwise Accuracy (self-reported) | 80 |
| MMLU | 79.1 | Accuracy (%) | 79.1 |
| HellaSwag | 83 | Accuracy (%) | 77.6 |
| WinoGrande | 80.8 | Accuracy (%) | 77.5 |
Interactive version: theaggregate.ai/model?slug=qwen-2-5-coder-32b · How It Works · Data refreshed daily, snapshot 2026-10-20.