Yi-1.5-34B-32K — benchmark results

Provider: 01.AI. Released 2024-05-15. Access: Open.

Unified ELO 1383 ± 19, rank #1299 of 1776 rated models, from 137 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - GPQA15.1Score91.3
Open Chinese LLM - CMMLU70.96Accuracy (%)89.9
Open Chinese LLM - C-Eval Semantic88.81Accuracy (%)89
Open LLM Leaderboard - MMLU-Pro41.21Score85.9
Open Chinese LLM - WinoGrande68.11Accuracy (%)85.8
Open Chinese LLM - HellaSwag67.48Accuracy (%)83.4
Open LLM Leaderboard - BBH43.38Score82.5
Open Chinese LLM - ARC Challenge58.02Accuracy (%)78.3
Open LLM Leaderboard - MuSR14.08Score77.1
Open Arabic LLM - Arabic MMLU HT College Mathematics36Accuracy (%)67
Open Arabic LLM - Arabic MMLU HT High School Mathematics32.96Accuracy (%)64.2
Open LLM Leaderboard - MATH Level 515.41Score62.7

Interactive version: theaggregate.ai/model?slug=yi-1-5-34b-32k · How the rankings work · Data refreshed daily, snapshot 2026-07-22.