Yi-9B: benchmark results

01.AI's Yi-9B, a bilingual base model in the Yi series trained from scratch on a 3T-token multilingual corpus. Provider: 01.AI. Released 2024-03-06. Access: Open.

Aggregate Rating 1401 ± 22, rank #1222 of 1656 rated models, from 31 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU70.06Accuracy (%) (5-shot)93.3
Open LLM Leaderboard - GPQA31.8Score73.8
Open Chinese LLM - C-Eval Semantic82.42Accuracy (%)72.8
Open Chinese LLM - CMMLU61.66Accuracy (%)71.3
Open Portuguese LLM - FaQuAD NLI74.79Macro F1 (%)71.3
Open Portuguese LLM - OAB Exams47.84Accuracy (%)67.5
Open Portuguese LLM - ENEM67.6Accuracy (%)67.4
Open Chinese LLM - HellaSwag62.12Accuracy (%)66.1
Open Chinese LLM - WinoGrande64.25Accuracy (%)65.5
Open LLM Leaderboard v1 - GSM8K48.98Accuracy (%) (5-shot)62
Open Portuguese LLM - BLUEX54.94Accuracy (%)61.9
Open Chinese LLM Leaderboard58.34Official Nonzero-Task Mean (%)60.4

Interactive version: theaggregate.ai/model?slug=yi-9b · How It Works · Data refreshed daily, snapshot 2026-10-20.