Qwen-1.8B — benchmark results

Provider: Alibaba. Released 2023-11-30. Access: Open.

Unified ELO 1184 ± 19, rank #1708 of 1776 rated models, from 8 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ARC Challenge (AI2)53.2Accuracy (%)44.2
BoolQ68Accuracy (%)23.4
GSM8K21.2Accuracy (%)21.3
InfiBench23.12Score (%)17.1
PIQA73.3Accuracy (%)8.3
MMLU28.2Accuracy (%)4.4
Epoch AI - Lambada58.4Score4
Big-Bench Hard28.2Average (%)0

Interactive version: theaggregate.ai/model?slug=qwen-1-8b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.