Llama 3.1 8B Pre Trained Mixed Korean Articles: benchmark results

Provider: Meta. Access: Open.

Unified ELO 1384 ± 17, rank #2024 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond25.25Normalized accuracy (%)75.9
Open Korean LLM - Ko-Winogrande61.25Accuracy (%)60.9
Open Korean LLM - KorNAT-Helpful46.52Normalized accuracy (%)47.2
Open Korean LLM - Ko-EQ-Bench0.23EQ-Bench score44.2
Open Korean LLM - Ko-IFEval26.14Strict accuracy, prompt/instruction mean (%)38.2
Open Korean LLM - Ko-GSM8K (flexible extract)9.48Exact match, flexible extract (%)32.7
Open Korean LLM Leaderboard32.32Average Score (%)32.7
Open Ko-LLM Leaderboard32.32Average (%)32.5
Open Korean LLM - KorNAT-Harmless61.16Normalized accuracy (%)24.1
Open Korean LLM - KorNAT-CKA19.29Normalized accuracy (%)23.6

Interactive version: theaggregate.ai/model?slug=llama-3-1-8b-pre-trained-mixed-korean-articles · How It Works · Data refreshed daily, snapshot 2026-09-19.