LLaMA3-iterative-DPO-final: benchmark results

RLHFlow's LLaMA3-iterative-DPO-final, trained with an iterative online DPO-based RLHF recipe on open-source datasets only, from the 'RLHF Workflow' paper's reward-modeling-to-online-RLHF pipeline. Provider: RLHFlow. Released 2024-05-17. Access: Open.

Aggregate Rating 1455 ± 19, rank #970 of 1656 rated models, from 27 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GSM8K (flexible extract)62.77Exact match, flexible extract (%)95.6
Open Ko-LLM Leaderboard45.23Average (%)91.4
Open Korean LLM Leaderboard45.23Average Score (%)91.4
Open Korean LLM - KorNAT-Harmless67.68Normalized accuracy (%)90.2
Open Korean LLM - Ko-IFEval38.69Strict accuracy, prompt/instruction mean (%)80
Open Korean LLM - Ko-EQ-Bench30.55EQ-Bench score79.4
Open Portuguese LLM - ASSIN2 RTE92.28Macro F1 (%)77.3
Open Korean LLM - Ko-GPQA-Diamond25.25Normalized accuracy (%)75.9
Open Korean LLM - KorNAT-CKA27.98Normalized accuracy (%)73
Open Portuguese LLM - BLUEX58Accuracy (%)71.7
Open Portuguese LLM - ENEM67.39Accuracy (%)66.7
Open Korean LLM - KorNAT-Helpful48.23Normalized accuracy (%)65.8

Interactive version: theaggregate.ai/model?slug=llama3-iterative-dpo-final · How It Works · Data refreshed daily, snapshot 2026-10-20.