Yi-1.5-9B Chat: benchmark results

01.AI's Apache-2.0 9B chat model from the Yi-1.5 series (May 2024), continually pretrained on 500B extra tokens and tuned on 3M samples. Provider: 01.AI. Released 2024-05-13. Access: Open.

Aggregate Rating 1443 ± 8, rank #1031 of 1656 rated models, from 500 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LA Leaderboard - ParafrasesGL56.12Accuracy (%)97.1
OpenCompass Reasoning - Abductive - English (CompassBench 2405)88Score (%)96.1
LatamBoard - Spanish MGSM18.8Score (%)93.9
LA Leaderboard - ClinTreatES64.88Semantic Answer Similarity (x100)92.5
Mobile-MMLU72.7Overall Accuracy (%)90.5
LA Leaderboard - MGSM Galician8.8Exact Match (%)88.5
LA Leaderboard - PAWS Catalan68.05Accuracy (%)88.2
LA Leaderboard - Spanish Law Exams39.5Accuracy (%)88.2
Open Chinese LLM - GSM8K64.22Accuracy (%)88.2
LatamBoard - Spanish Escola71.04Score (%)87.9
LA Leaderboard - Belebele Catalan80.67Accuracy (%)86.8
LatamBoard - Spanish PAWS63Score (%)86.4

Interactive version: theaggregate.ai/model?slug=yi-1-5-9b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.