Qwen2.5-Math-1.5B-Instruct: benchmark results

Alibaba's Qwen2.5-Math-1.5B-Instruct, the instruction-tuned version of Qwen2.5-Math-1.5B for solving English and Chinese math problems via chain-of-thought and tool-integrated reasoning. Provider: Alibaba. Released 2024-09-19. Access: Open.

Aggregate Rating 1268 ± 31, rank #1522 of 1656 rated models, from 31 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MATH Level 526.28Score79.2
MERA - ruHumanEval15.98pass@1 (%)57.9
MERA - ruCodeEval15.12pass@1 (%)57.6
MERA - LCS13Accuracy (%)51
MERA - ruMultiAr30.08EM (%)47.1
MERA - ruModAr49.53EM (%)39.1
MERA - SimpleAr95.3EM (%)37.1
Open LLM Leaderboard - MuSR36.85Score23
MERA - RWSD50.38Accuracy (%)22.1
MERA - MathLogicQA34.91Accuracy (%)21.9
Open LLM Leaderboard - BBH37.52Score21.6
ReliableMath - Prudence0Score (%)21.1

Interactive version: theaggregate.ai/model?slug=qwen2-5-math-1-5b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.