Yi 1.5 34B: benchmark results
01.AI's open 34B upgrade of Yi, continually pre-trained on 500B extra tokens for stronger coding, math, reasoning, and instruction following. Provider: 01.AI. Released 2024-05-13. Access: Open.
Aggregate Rating 1492 ± 14, rank #807 of 1656 rated models, from 176 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval English Common Sense Reasoning | 94.53 | Common Sense Reasoning Average Score (%) | 99.4 |
| Open LLM Leaderboard v1 - MMLU | 78 | Accuracy (%) (5-shot) | 99.1 |
| Open LLM Leaderboard v1 - GSM8K | 73.24 | Accuracy (%) (5-shot) | 98.6 |
| EuroEval Spanish NLU - MLQA ES | 69.63 | Character F1 (%) | 97.8 |
| EuroEval English | 77.14 | Average Score (%) | 97 |
| EuroEval English NLU - SQuAD | 88.19 | Character F1 (%) | 96.6 |
| EuroEval French NLU - FQuAD | 75.71 | Character F1 (%) | 96.1 |
| EuroEval Finnish NLU - Tydiqa FI | 75.98 | Character F1 (%) | 95.7 |
| EuroEval German NLU - Germanquad | 68.22 | Character F1 (%) | 95.3 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 77.91 | Character F1 (%) | 95.2 |
| EuroEval Dutch NLU - SQuAD NL | 81.65 | Character F1 (%) | 95.1 |
| EuroEval Italian NLU - SQuAD IT | 74.69 | Character F1 (%) | 95.1 |
Interactive version: theaggregate.ai/model?slug=yi-1-5-34b · How It Works · Data refreshed daily, snapshot 2026-10-20.