Qwen 1.5 7B Chat: benchmark results
Alibaba's Qwen1.5-7B-Chat, the aligned chat version in the Qwen1.5 (Qwen2 beta) series, post-trained with SFT and DPO, supporting a stable 32K context. Provider: Alibaba. Released 2024-02-04. Access: Open.
Aggregate Rating 1393 ± 9, rank #6364 of 10318 rated models, from 309 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| TCMQA v1 - Full | 61.23 | Exact-match accuracy (%) | 76.9 |
| TCMQA v1 - Multi Answer | 22.88 | Exact-set accuracy (%) | 76.9 |
| TCMQA v1 - Single Answer | 63.78 | Exact-match accuracy (%) | 76.9 |
| RewardBench Reasoning | 90.41 | Accuracy (%) | 74 |
| TCMQA v1 - Practitioner Subset | 70.71 | Exact-match accuracy (%) | 73.1 |
| OpenEval - Omni-MATH | 9.53 | Accuracy (%) | 71.4 |
| OpenCompass Agent - CIBench - English (CompassBench 2402) | 51.1 | Score (%) | 70.6 |
| ChineseSafe Benchmark | 70.36 | Accuracy (%) | 70.4 |
| OR-Bench - 80K | 4.4 | Rejection rate on benign seemingly toxic prompts (%, OR-Benc | 68.4 |
| OpenEval - BBQ | 76.6 | Exact Match (%) | 66.7 |
| OpenEval - GPQA CoT | 24.44 | CoT Correctness (%) | 66.7 |
| OpenEval - MMLU-Pro CoT | 23.6 | CoT Correctness (%) | 66.7 |
Interactive version: theaggregate.ai/model?slug=qwen-1-5-7b-chat · How It Works · Data refreshed daily, snapshot 2026-11-14.