Qwen 2.5 0.5B: benchmark results

Alibaba's open Qwen 2.5 0.5B, the smallest model in the Qwen 2.5 family (September 2024). Provider: Alibaba. Released 2024-09-19. Access: Open.

Aggregate Rating 1234 ± 14, rank #1560 of 1656 rated models, from 280 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Arabic LLM - Arabic MMLU Civics (High School)44.83Accuracy (%)56.5
Open Japanese LLM - CG2.41Score (%)41
Open Japanese LLM - Mbpp Pylint Check8.43Score (%)38
Swallow - Pre-trained English - GSM8K34.1Exact Match (%)32.7
Open Japanese LLM - Xlsum JA Bert Score JA F167.54Score (%)31
Swallow - Pre-trained English - HumanEval27.7Pass@1 (%)30.6
Open Japanese LLM - Xlsum JA Rouge120.76Score (%)29.1
Open Japanese LLM - Xlsum JA RougeLsum17.84Score (%)28.7
Swallow - Pre-trained English - MATH14.8Exact Match (%)28.6
Open Arabic LLM - Arabic MMLU HT Machine Learning31.25Accuracy (%)27.2
Open Japanese LLM - SUM7.47Score (%)27.2
Open Japanese LLM - Xlsum JA Rouge27.48Score (%)27.2

Interactive version: theaggregate.ai/model?slug=qwen-2-5-0-5b · How It Works · Data refreshed daily, snapshot 2026-10-20.