MoE_13B_DPO: benchmark results

yunconglong's DPO fine-tune of their Truthful DPO FusionNet 7Bx2 MoE 13B model, trained on the Intel Orca DPO pairs dataset. Provider: yunconglong. Released 2024-01-28. Access: Open.

Aggregate Rating 1477 ± 24, rank #854 of 1635 rated models, from 19 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande88Accuracy (%) (5-shot)99.8
Open LLM Leaderboard v1 - ARC Challenge74.32Normalized accuracy (%) (25-shot)99.2
Open LLM Leaderboard v1 - HellaSwag89.39Normalized accuracy (%) (10-shot)99.2
Open LLM Leaderboard v1 - TruthfulQA MC278.47MC2 (%) (0-shot)99.1
Open Chinese LLM - TruthfulQA MC62.61Accuracy (%)91.4
Open LLM Leaderboard v1 - GSM8K67.63Accuracy (%) (5-shot)84
Open Chinese LLM - WinoGrande67.48Accuracy (%)83.4
Open Portuguese LLM - ASSIN2 RTE92.57Macro F1 (%)80.4
Open Portuguese LLM - FaQuAD NLI77.36Macro F1 (%)79.5
Open LLM Leaderboard v1 - MMLU64.48Accuracy (%) (5-shot)71.1
Open Chinese LLM - HellaSwag61.77Accuracy (%)64.8
Open Chinese LLM - ARC Challenge54.1Accuracy (%)63.3

Interactive version: theaggregate.ai/model?slug=moe-13b-dpo · How It Works · Data refreshed daily, snapshot 2026-11-05.