blossom-v5.1-34B: benchmark results

Azure99's Blossom v5.1 bilingual Chinese-English chat fine-tune of Yi-1.5-34B, trained in two stages on Wizard, Orca, Math and Blossom dialogue data (May 2024). Provider: Azure99. Released 2024-05-19. Access: Open.

Aggregate Rating 1499 ± 23, rank #786 of 1656 rated models, from 25 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU78.05Accuracy (%) (5-shot)99.1
Open Portuguese LLM - FaQuAD NLI81.88Macro F1 (%)93.3
Open Chinese LLM - GSM8K67.85Accuracy (%)92
Open Chinese LLM - C-Eval Semantic89.74Accuracy (%)91.4
Open Chinese LLM Leaderboard68.68Official Nonzero-Task Mean (%)90.8
Open Chinese LLM - ARC Challenge61.18Accuracy (%)90.1
Open Portuguese LLM - BLUEX67.18Accuracy (%)89.6
Open LLM Leaderboard v1 - WinoGrande83.43Accuracy (%) (5-shot)88.8
Open Chinese LLM - HellaSwag68.61Accuracy (%)88.6
Open Chinese LLM - WinoGrande68.51Accuracy (%)87
Open Chinese LLM - CMMLU70.37Accuracy (%)86.4
Open Portuguese LLM - OAB Exams54.44Accuracy (%)86.3

Interactive version: theaggregate.ai/model?slug=blossom-v5-1-34b · How It Works · Data refreshed daily, snapshot 2026-10-20.