Qwen 2 72B Instruct: benchmark results

Alibaba Qwen 2 72B instruction-tuned checkpoint. Provider: Alibaba. Released 2024-06-06. Access: Open.

Aggregate Rating 1562 ± 7, rank #576 of 1656 rated models, from 889 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM EWoK - Social Relations99.49Exact Match (%)100
HELM EWoK - Spatial Relations79.59EM100
HELM SeaHELM - IndoNLI86EM100
LLM Stats (TheoremQA)44.4Score (%)100
Open Chinese LLM - C-Eval Semantic94.12Accuracy (%)100
Open Chinese LLM - GSM8K78.7Accuracy (%)100
Open Chinese LLM Leaderboard75.67Official Nonzero-Task Mean (%)100
OpenCompass Knowledge - Engineering - Chinese (CompassBench 2407)85.6Score (%)100
OpenCompass Knowledge - Science - English (CompassBench 2407)92Score (%)100
SeaEval - Cultural Reasoning - US-Eval (Zero-Shot)87.85Accuracy (%)100
SeaEval - Fundamental NLP Tasks - MRPC (Zero-Shot)80.64Accuracy (%)100
SeaEval - Fundamental NLP Tasks - OCNLI (Zero-Shot)78.2Accuracy (%)100

Interactive version: theaggregate.ai/model?slug=qwen-2-72b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.