Llama-3-Base-8B-SFT-RRHF: benchmark results

Princeton NLP's Llama-3-Base-8B-SFT-RRHF, a Llama 3 8B base model with SFT and RRHF alignment, released alongside Princeton's SimPO preference-optimization paper. Provider: Princeton NLP. Released 2024-07-06. Access: Open.

Aggregate Rating 1380 ± 21, rank #1282 of 1654 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond27.27Normalized accuracy (%)92.4
Open Korean LLM - KorNAT-Harmless65.44Normalized accuracy (%)80.3
Open Korean LLM - Ko-Winogrande63.3Accuracy (%)73.4
Open Korean LLM - Ko-EQ-Bench20.37EQ-Bench score66.3
Open Portuguese LLM - ENEM66.13Accuracy (%)63.6
Open Korean LLM Leaderboard37.57Average Score (%)62.6
Open Portuguese LLM - OAB Exams45.97Accuracy (%)62.6
Open LLM Leaderboard - GPQA30.54Score62.3
Open Korean LLM - KorNAT-Helpful47.8Normalized accuracy (%)60.8
Open Portuguese LLM - BLUEX53.82Accuracy (%)57.4
Open Korean LLM - Ko-GSM8K (flexible extract)14.25Exact match, flexible extract (%)42.6
Open Korean LLM - Ko-IFEval25.93Strict accuracy, prompt/instruction mean (%)37.3

Interactive version: theaggregate.ai/model?slug=llama-3-base-8b-sft-rrhf · How It Works · Data refreshed daily, snapshot 2026-10-24.