Qwen 1.5 0.5B Chat: benchmark results

Alibaba's Qwen1.5-0.5B-Chat, the aligned chat version of Qwen1.5-0.5B, post-trained with supervised fine-tuning and direct preference optimization, supporting a 32K context window. Provider: Alibaba. Released 2024-02-04. Access: Open.

Aggregate Rating 1192 ± 16, rank #1591 of 1656 rated models, from 161 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench Chat Hard62.94Accuracy (%)54.5
MERA - LCS11.8Accuracy (%)41.9
EuroEval Norwegian Knowledge - Idioms NO1.21MCC (x100)38.4
Open LLM Leaderboard - MuSR38.37Score31.4
EuroEval Spanish NLU - MLQA ES44.87Character F1 (%)28.9
Open LLM Leaderboard v1 - GSM8K7.66Accuracy (%) (5-shot)27.2
EuroEval French NLU - FQuAD44.28Character F1 (%)27.1
EuroEval Icelandic Knowledge2.15Knowledge Average Score (%)26.3
EuroEval Portuguese NLU - MultiWikiQA PT41.92Character F1 (%)26.3
EuroEval Italian NLU - SQuAD IT40.64Character F1 (%)25.1
Open LLM Leaderboard - GPQA26.93Score23.8
MERA - RWSD50.38Accuracy (%)22.1

Interactive version: theaggregate.ai/model?slug=qwen-1-5-0-5b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.