Yi 1.5 34B Chat: benchmark results
01.AI's 34B chat model from the Yi-1.5 series, continue-pretrained on 500B extra tokens for stronger coding, math, reasoning and instruction following (May 2024). Provider: 01.AI. Released 2024-05-13. Access: Open.
Unified ELO 1474 ± 1, rank #815 of 1392 rated models, from 98 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open CoT - LSAT Logical Reasoning | 24.71 | CoT Gain (%) | 100 |
| Open Chinese LLM - GSM8K | 68.31 | Accuracy (%) | 92.9 |
| Open LLM Leaderboard - GPQA | 15.32 | Score | 91.6 |
| Open Chinese LLM - ARC Challenge | 61.6 | Accuracy (%) | 90.9 |
| Open Chinese LLM Leaderboard | 68.17 | Average Score (%) | 90.2 |
| Open CoT Leaderboard | 13.81 | Average CoT Gain (%) | 90.1 |
| Open CoT - LogiQA 2 | 14.19 | CoT Gain (%) | 88.2 |
| Open CoT - LSAT Reading Comprehension | 20.45 | CoT Gain (%) | 87 |
| Open Chinese LLM - WinoGrande | 68.27 | Accuracy (%) | 86.5 |
| Open Chinese LLM - C-Eval Semantic | 87.44 | Accuracy (%) | 85.3 |
| Open LLM Leaderboard - BBH | 44.26 | Score | 84.5 |
| Open LLM Leaderboard - MMLU-Pro | 39.12 | Score | 84.1 |
Interactive version: theaggregate.ai/model?slug=yi-1-5-34b-chat · How It Works · Data refreshed daily, snapshot 2026-09-05.