Yi 1.5 34B Chat: benchmark results
01.AI's 34B chat model from the Yi-1.5 series, continue-pretrained on 500B extra tokens for stronger coding, math, reasoning and instruction following (May 2024). Provider: 01.AI. Released 2024-05-13. Access: Open.
Aggregate Rating 1495 ± 9, rank #800 of 1656 rated models, from 423 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open CoT - LSAT Logical Reasoning | 24.71 | CoT Gain (%) | 100 |
| OpenCompass Language - Sentiment Analysis - English (CompassBench 2405) | 82 | Score (%) | 100 |
| Open PL LLM - PolEmo2-OUT (multiple choice, 5-shot) | 82.79 | Accuracy (%) | 99.4 |
| OpenCompass Subjective - Conversation - Chinese (CompassBench 2405) | 61.4 | Score (%) | 94.7 |
| Open PL LLM - PSC (generative, 5-shot) | 98.26 | Binary F1 (%) | 94.1 |
| OpenCompass Language - Dialogue - English (CompassBench 2407) | 57.5 | Score (%) | 94.1 |
| Open Chinese LLM - GSM8K | 68.31 | Accuracy (%) | 92.9 |
| OpenCompass Knowledge - Natural Science - Chinese (CompassBench 2405) | 55.3 | Score (%) | 92.1 |
| OpenCompass Subjective - Creation - Chinese (CompassBench 2405) | 50.8 | Score (%) | 92.1 |
| Open Chinese LLM Leaderboard | 68.92 | Official Nonzero-Task Mean (%) | 91.7 |
| Open LLM Leaderboard - GPQA | 36.49 | Score | 91.6 |
| Open Chinese LLM - ARC Challenge | 61.6 | Accuracy (%) | 91 |
Interactive version: theaggregate.ai/model?slug=yi-1-5-34b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.