Qwen-1.8B: benchmark results
Provider: Alibaba. Released 2023-11-30. Access: Open.
Unified ELO 1281 ± 1, rank #1366 of 1392 rated models, from 8 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| ARC Challenge (AI2) | 53.2 | Accuracy (%) | 45.4 |
| BoolQ | 68 | Accuracy (%) | 23.4 |
| GSM8K | 21.2 | Accuracy (%) | 21.5 |
| InfiBench | 23.12 | Score (%) | 17.1 |
| PIQA | 73.3 | Accuracy (%) | 8.3 |
| MMLU | 28.2 | Accuracy (%) | 4.4 |
| Epoch AI - Lambada | 58.4 | Score | 4 |
| Big-Bench Hard | 28.2 | Average (%) | 0 |
Interactive version: theaggregate.ai/model?slug=qwen-1-8b · How It Works · Data refreshed daily, snapshot 2026-09-05.