Qwen 1.5 0.5B: benchmark results

Alibaba's Qwen1.5-0.5B base model, the beta version of Qwen2, supporting a 32K context window as part of an eight-size family from 0.5B to 72B parameters. Provider: Alibaba. Released 2024-02-04. Access: Open.

Aggregate Rating 1207 ± 18, rank #1578 of 1656 rated models, from 153 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Japanese LLM - Mbpp Pylint Check14.26Score (%)42.7
Open LLM Leaderboard v1 - GSM8K16.3Accuracy (%) (5-shot)38.1
Open Japanese LLM - CG1.41Score (%)36.8
Open Portuguese LLM - FaQuAD NLI52.54Macro F1 (%)34.2
MERA - RWSD52.31Accuracy (%)30.7
EuroEval Spanish NLU - ScaLA ES1.58Matthews correlation coefficient (%)30.4
SALAD-Bench Attack7.78Safety Score (%)30.3
MERA - LCS10.2Accuracy (%)27.9
EuroEval Faroese NLU - ScaLA FO0.45Matthews correlation coefficient (%)24.7
MERA - ruCodeEval0.3pass@1 (%)24.5
SALAD-Bench44.07Average Safety Score (%)21.2
SALAD-Bench Base80.36Safety Score (%)21.2

Interactive version: theaggregate.ai/model?slug=qwen-1-5-0-5b · How It Works · Data refreshed daily, snapshot 2026-10-20.