Llama-3-Instruct-8B-RRHF: benchmark results

Princeton NLP's Llama-3-Instruct-8B-RRHF, a Llama 3 8B Instruct model aligned via RRHF, released alongside Princeton's SimPO preference-optimization paper. Provider: Princeton NLP. Released 2024-07-06. Access: Open.

Aggregate Rating 1434 ± 21, rank #1077 of 1654 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GSM8K (flexible extract)54.74Exact match, flexible extract (%)88.6
Open Korean LLM - Ko-IFEval42.72Strict accuracy, prompt/instruction mean (%)86.8
Open LLM Leaderboard - IFEval72.75Score86.7
Open Korean LLM - Ko-EQ-Bench35.75EQ-Bench score86
Open Portuguese LLM - OAB Exams50.66Accuracy (%)78.1
Open Korean LLM Leaderboard39.96Average Score (%)74.5
Open Korean LLM - KorNAT-Helpful48.85Normalized accuracy (%)73.6
Open Portuguese LLM - ENEM69.21Accuracy (%)72.6
Open Portuguese LLM - BLUEX57.3Accuracy (%)69.4
Open Portuguese LLM - ASSIN2 RTE91.03Macro F1 (%)62.7
Open Korean LLM - Ko-GPQA-Diamond24.24Normalized accuracy (%)62.4
Open Portuguese LLM - FaQuAD NLI69.49Macro F1 (%)59.4

Interactive version: theaggregate.ai/model?slug=llama-3-instruct-8b-rrhf · How It Works · Data refreshed daily, snapshot 2026-10-24.