Llama-3-Base-8B-SFT: benchmark results

Princeton NLP's 8B Llama 3 base checkpoint after supervised fine-tuning only, released as the SFT baseline in their SimPO preference-optimization research. Provider: Princeton NLP. Released 2024-05-17. Access: Open.

Aggregate Rating 1357 ± 19, rank #1370 of 1661 rated models, from 21 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Portuguese LLM - ENEM65.92Accuracy (%)63
Open Portuguese LLM - OAB Exams46.15Accuracy (%)63
Open Korean LLM - Ko-Winogrande61.48Accuracy (%)62.4
Open Korean LLM - Ko-EQ-Bench8.49EQ-Bench score54.8
Open LLM Leaderboard - GPQA29.78Score53.6
Open Korean LLM - Ko-GSM8K (flexible extract)21Exact match, flexible extract (%)53.2
Open Portuguese LLM - BLUEX52.29Accuracy (%)52.2
Open LLM Leaderboard - MuSR41.18Score51.9
Open Korean LLM - KorNAT-Helpful46.83Normalized accuracy (%)49.7
Open Korean LLM Leaderboard34.7Average Score (%)48.5
Open Ko-LLM Leaderboard34.7Average (%)48.4
Open Korean LLM - KorNAT-Harmless62.45Normalized accuracy (%)44.2

Interactive version: theaggregate.ai/model?slug=llama-3-base-8b-sft · How It Works · Data refreshed daily, snapshot 2026-10-23.