Qwen 1.5 7B Chat: benchmark results

Alibaba's Qwen1.5-7B-Chat, the aligned chat version in the Qwen1.5 (Qwen2 beta) series, post-trained with SFT and DPO, supporting a stable 32K context. Provider: Alibaba. Released 2024-02-04. Access: Open.

Aggregate Rating 1393 ± 9, rank #6364 of 10318 rated models, from 309 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
TCMQA v1 - Full61.23Exact-match accuracy (%)76.9
TCMQA v1 - Multi Answer22.88Exact-set accuracy (%)76.9
TCMQA v1 - Single Answer63.78Exact-match accuracy (%)76.9
RewardBench Reasoning90.41Accuracy (%)74
TCMQA v1 - Practitioner Subset70.71Exact-match accuracy (%)73.1
OpenEval - Omni-MATH9.53Accuracy (%)71.4
OpenCompass Agent - CIBench - English (CompassBench 2402)51.1Score (%)70.6
ChineseSafe Benchmark70.36Accuracy (%)70.4
OR-Bench - 80K4.4Rejection rate on benign seemingly toxic prompts (%, OR-Benc68.4
OpenEval - BBQ76.6Exact Match (%)66.7
OpenEval - GPQA CoT24.44CoT Correctness (%)66.7
OpenEval - MMLU-Pro CoT23.6CoT Correctness (%)66.7

Interactive version: theaggregate.ai/model?slug=qwen-1-5-7b-chat · How It Works · Data refreshed daily, snapshot 2026-11-14.