Qwen 1.5 4B: benchmark results
Provider: Alibaba. Released 2024-02-05. Access: Open.
Unified ELO 1372 ± 1, rank #1214 of 1392 rated models, from 228 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Arabic LLM - Aratrust Offensive | 89.86 | Accuracy (%) | 80.7 |
| MERA - RWSD | 58.46 | Accuracy (%) | 62.4 |
| Open Chinese LLM - WinoGrande | 63.85 | Accuracy (%) | 61.9 |
| EuroEval Danish Knowledge | 38.12 | Knowledge Average Score (%) | 41.2 |
| EuroEval Norwegian Common Sense Reasoning | 35.96 | Common Sense Reasoning Average Score (%) | 40.9 |
| Open Chinese LLM - C-Eval Semantic | 66.37 | Accuracy (%) | 40.4 |
| EuroEval Dutch NLU - DBRD | 83.66 | Sentiment classification Score (%) | 39 |
| Open Arabic LLM - Arabic MMLU HT Medical Genetics | 41 | Accuracy (%) | 38.9 |
| Open Arabic LLM - Arabic MMLU Management (University) | 64 | Accuracy (%) | 38.6 |
| EuroEval Portuguese NLU - ScaLA PT | 7.06 | Linguistic acceptability Score (%) | 38.2 |
| Open Arabic LLM - Arabic MMLU Computer Science (Primary School) | 60 | Accuracy (%) | 38 |
| EuroEval English Knowledge | 62.85 | Knowledge Average Score (%) | 37.9 |
Interactive version: theaggregate.ai/model?slug=qwen-1-5-4b · How It Works · Data refreshed daily, snapshot 2026-09-05.