Yi-1.5-9B-Chat [chat template]: benchmark results

Provider: 01.AI. Released 2024-05-13. Access: Open.

Aggregate Rating 1446 ± 35, rank #3961 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K71.87Accuracy (%) (5-shot)96.8
Open LLM Leaderboard v1 - MMLU71.01Accuracy (%) (5-shot)94.6
Open LLM Leaderboard v1 - ARC Challenge63.65Normalized accuracy (%) (25-shot)63.7
Open LLM Leaderboard v1 - TruthfulQA MC252.67MC2 (%) (0-shot)57
Open LLM Leaderboard v1 - WinoGrande77.19Accuracy (%) (5-shot)53.9
Open LLM Leaderboard v1 - HellaSwag80.94Normalized accuracy (%) (10-shot)42.9

Interactive version: theaggregate.ai/model?slug=yi-1-5-9b-chat-chat-template · How It Works · Data refreshed daily, snapshot 2026-11-08.