Qwen1.5-MoE-A2.7B: benchmark results
Provider: Alibaba. Released 2024-02-29. Access: Open.
Unified ELO 1393 ± 1, rank #1163 of 1392 rated models, from 65 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Chinese LLM - WinoGrande | 64.17 | Accuracy (%) | 65 |
| Open Japanese LLM - Xlsum JA Rouge1 | 27.11 | Score (%) | 61.9 |
| Open Chinese LLM - CMMLU | 56.45 | Accuracy (%) | 61.1 |
| Open Japanese LLM - Xlsum JA RougeLsum | 22.83 | Score (%) | 59.5 |
| Open Chinese LLM - C-Eval Semantic | 70.25 | Accuracy (%) | 52.2 |
| Open Japanese LLM - CG | 8.63 | Score (%) | 49.2 |
| Open Japanese LLM - Mbpp Pylint Check | 23.49 | Score (%) | 46.6 |
| Open Japanese LLM - Xlsum JA Bert Score JA F1 | 68.75 | Score (%) | 46.5 |
| CyberMetric | 62.37 | Accuracy (%) | 45.8 |
| Open LLM Leaderboard - MATH Level 5 | 9.29 | Score | 45.1 |
| Open Chinese LLM - HellaSwag | 59.17 | Accuracy (%) | 43.6 |
| Open Japanese LLM - Jsick Exact Match | 76.29 | Score (%) | 43 |
Interactive version: theaggregate.ai/model?slug=qwen1-5-moe-a2-7b · How It Works · Data refreshed daily, snapshot 2026-09-05.