Qwen1.5-1.8B_llamafy: benchmark results

Provider: Alibaba. Access: Open.

Aggregate Rating 1265 ± 42, rank #9118 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K30.33Accuracy (%) (5-shot)47.3
Open LLM Leaderboard v1 - MMLU46.82Accuracy (%) (5-shot)25.6
Open LLM Leaderboard v1 - HellaSwag61.35Normalized accuracy (%) (10-shot)15.4
Open LLM Leaderboard v1 - ARC Challenge37.46Normalized accuracy (%) (25-shot)14.6
Open LLM Leaderboard v1 - WinoGrande60.54Accuracy (%) (5-shot)13.7
Open LLM Leaderboard v1 - TruthfulQA MC239.42MC2 (%) (0-shot)11

Interactive version: theaggregate.ai/model?slug=qwen1-5-1-8b-llamafy · How It Works · Data refreshed daily, snapshot 2026-11-08.