Qwen 1.5 7B Chat: benchmark results

Alibaba's Qwen1.5-7B-Chat, the aligned chat version in the Qwen1.5 (Qwen2 beta) series, post-trained with SFT and DPO, supporting a stable 32K context. Provider: Alibaba. Released 2024-02-04. Access: Open.

Aggregate Rating 1374 ± 10, rank #1324 of 1656 rated models, from 290 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench Reasoning90.41Accuracy (%)74
OpenCompass Agent - CIBench - English (CompassBench 2402)51.1Score (%)70.6
ChineseSafe Benchmark70.36Accuracy (%)70.4
Open Portuguese LLM - FaQuAD NLI72.46Macro F1 (%)65.7
OpenCompass Math - Middle School - Chinese (CompassBench 2405)47.4Score (%)64.5
BiGGen-Bench3.56Average Score (1-5)63.7
RewardBench Chat Hard69.08Accuracy (%)63.6
OpenCompass Language - Content Summarization - English (CompassBench 2405)28.8Score (%)63.2
MERA - RWSD58.46Accuracy (%)62.6
Open PL LLM - PolEmo2-OUT (multiple choice, 5-shot)71.26Accuracy (%)62.5
OpenCompass Subjective - Creation (CompassBench 2404)38.3Score (%)62
Open LLM Leaderboard - GPQA30.29Score59.3

Interactive version: theaggregate.ai/model?slug=qwen-1-5-7b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.