Yi-34B-200K — benchmark results

01.AI's 34B bilingual base model trained on 3T tokens (November 2023), with its context window extended to 200K. Provider: 01.AI. Released 2023-11-06. Access: Open.

Unified ELO 1402 ± 32, rank #1214 of 1776 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - GPQA14.21Score89.8
Open Chinese LLM - WinoGrande69.14Accuracy (%)89.3
Open LLM Leaderboard - MMLU-Pro39.27Score84.3
Open Chinese LLM - CMMLU68.37Accuracy (%)80.7
Open Chinese LLM - HellaSwag66.01Accuracy (%)80.4
Open Chinese LLM - C-Eval Semantic85.72Accuracy (%)77.7
Open Chinese LLM - ARC Challenge57.17Accuracy (%)74.2
Open LLM Leaderboard - BBH36.02Score73.5
HELMET (128K)40.3Average Score71
EffiBench - NET2.91Normalized Execution Time67.1
BABILong (NIAH)54Avg Accuracy (%)62.1
Open Chinese LLM Leaderboard57.87Average Score (%)61.1

Interactive version: theaggregate.ai/model?slug=yi-34b-200k · How the rankings work · Data refreshed daily, snapshot 2026-07-22.