Yi-1.5-9B: benchmark results

01.AI's Apache-2.0 9B Yi-1.5 base model (May 2024) with improved coding, math, reasoning, and instruction-following over the original Yi. Provider: 01.AI. Released 2024-05-13. Access: Open.

Aggregate Rating 1395 ± 10, rank #1241 of 1656 rated models, from 411 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LA Leaderboard - CatalanQA84.05F1 (%)98.5
LA Leaderboard - XQuAD Catalan77.5F1 (%)98.5
LA Leaderboard - XQuAD Spanish79.5F1 (%)98.5
LA Leaderboard - PAWS Catalan70.5Accuracy (%)97.1
LA Leaderboard - Summarization Galician7.35BLEU95.5
Open LLM Leaderboard - GPQA37.92Score94.6
Open LLM Leaderboard v1 - MMLU70.73Accuracy (%) (5-shot)94.3
EuroEval English NLU - SQuAD86.89Character F1 (%)92.6
LA Leaderboard - XL-Sum Spanish3.26BLEU92.5
EuroEval English NLU - SST-569.2Matthews correlation coefficient (%)92.4
LA Leaderboard - MGSM Catalan12.4Exact Match (%)92.3
EuroEval German NLU - Germanquad66.85Character F1 (%)92.2

Interactive version: theaggregate.ai/model?slug=yi-1-5-9b · How It Works · Data refreshed daily, snapshot 2026-10-20.