Yi-34Bx2-MoE-60B-DPO: benchmark results

cloudyu's DPO-tuned version of their 2x34B Yi-based mixture-of-experts, Yi-34Bx2-MoE-60B. Provider: cloudyu. Released 2024-01-23. Access: Open.

Aggregate Rating 1521 ± 22, rank #714 of 1656 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K73.92Accuracy (%) (5-shot)98.9
Open LLM Leaderboard v1 - MMLU77.36Accuracy (%) (5-shot)98.6
Open Chinese LLM Leaderboard70.61Official Nonzero-Task Mean (%)95.9
Open Chinese LLM - C-Eval Semantic90.57Accuracy (%)95.3
Open Chinese LLM - ARC Challenge64.08Accuracy (%)95
Open LLM Leaderboard v1 - WinoGrande84.77Accuracy (%) (5-shot)95
Open Chinese LLM - WinoGrande70.64Accuracy (%)94.7
Open Chinese LLM - HellaSwag69.68Accuracy (%)92.6
Open Chinese LLM - CMMLU71.11Accuracy (%)90.8
Open LLM Leaderboard v1 - ARC Challenge71.25Normalized accuracy (%) (25-shot)88.6
Open LLM Leaderboard - MMLU-Pro46.77Score85.8
Open Chinese LLM - GSM8K60.35Accuracy (%)85.2

Interactive version: theaggregate.ai/model?slug=yi-34bx2-moe-60b-dpo · How It Works · Data refreshed daily, snapshot 2026-10-20.