llama3.1-korean-v0.1-sft-by-aidx: benchmark results

Provider: Meta. Access: Open.

Unified ELO 1530 ± 17, rank #938 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-IFEval46.92Strict accuracy, prompt/instruction mean (%)91.5
Open Korean LLM Leaderboard44.99Average Score (%)91.3
Open Ko-LLM Leaderboard44.99Average (%)91.2
Open Korean LLM - Ko-EQ-Bench39.79EQ-Bench score91.1
Open Korean LLM - Ko-GSM8K (flexible extract)55.04Exact match, flexible extract (%)88.9
Open Korean LLM - KorNAT-CKA30.36Normalized accuracy (%)82.8
Open Korean LLM - Ko-GPQA-Diamond24.24Normalized accuracy (%)62.4
Open Korean LLM - Ko-Winogrande59.67Accuracy (%)48.1
Open Korean LLM - KorNAT-Harmless62.33Normalized accuracy (%)41.8
Open Korean LLM - KorNAT-Helpful43.35Normalized accuracy (%)23.3

Interactive version: theaggregate.ai/model?slug=llama3-1-korean-v0-1-sft-by-aidx · How It Works · Data refreshed daily, snapshot 2026-09-19.