Llama-3-Instruct-8B-RDPO-v0.2: benchmark results

Princeton NLP's R-DPO (length-regularized DPO) v0.2 baseline on Llama 3 8B Instruct, from the SimPO paper's updated baseline suite. Provider: Princeton NLP. Released 2024-07-06. Access: Open.

Aggregate Rating 1451 ± 19, rank #997 of 1661 rated models, from 21 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond27.27Normalized accuracy (%)92.4
Open Korean LLM - Ko-GSM8K (flexible extract)57.01Exact match, flexible extract (%)91.3
Open Korean LLM - KorNAT-Helpful51.45Normalized accuracy (%)90.7
Open Korean LLM - Ko-IFEval45.64Strict accuracy, prompt/instruction mean (%)90.1
Open LLM Leaderboard - IFEval70.77Score84
Open Korean LLM Leaderboard41.36Average Score (%)82.2
Open Ko-LLM Leaderboard41.36Average (%)82.1
Open Korean LLM - Ko-EQ-Bench31.93EQ-Bench score81.1
Open Portuguese LLM - OAB Exams50.62Accuracy (%)77.9
Open Portuguese LLM - BLUEX58.28Accuracy (%)72.6
Open Portuguese LLM - ENEM68.51Accuracy (%)70.3
Open Korean LLM - KorNAT-CKA26.71Normalized accuracy (%)66.3

Interactive version: theaggregate.ai/model?slug=llama-3-instruct-8b-rdpo-v0-2 · How It Works · Data refreshed daily, snapshot 2026-10-23.