Qwen2-beta-72B: benchmark results

Provider: Alibaba.

Aggregate Rating 1493 ± 36, rank #2472 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU77.2Accuracy (%) (5-shot)98.4
Open LLM Leaderboard v1 - WinoGrande83.03Accuracy (%) (5-shot)86.8
Open LLM Leaderboard v1 - GSM8K65.73Accuracy (%) (5-shot)80.5
Open LLM Leaderboard v1 - HellaSwag85.99Normalized accuracy (%) (10-shot)77.9
Open LLM Leaderboard v1 - TruthfulQA MC259.61MC2 (%) (0-shot)74
Open LLM Leaderboard v1 - ARC Challenge65.87Normalized accuracy (%) (25-shot)71.4

Interactive version: theaggregate.ai/model?slug=qwen2-beta-72b · How It Works · Data refreshed daily, snapshot 2026-11-08.