llama3.1-korean-v1.2-sft-by-aidx: benchmark results

Provider: Meta. Access: Open.

Unified ELO 1544 ± 17, rank #867 of 2656 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard46.6Average Score (%)93.6
Open Ko-LLM Leaderboard46.6Average (%)93.5
Open Korean LLM - Ko-GSM8K (flexible extract)58.61Exact match, flexible extract (%)92.7
Open Korean LLM - KorNAT-CKA33.47Normalized accuracy (%)92.2
Open Korean LLM - Ko-EQ-Bench38.9EQ-Bench score89.8
Open Korean LLM - Ko-IFEval42.91Strict accuracy, prompt/instruction mean (%)87.1
Open Korean LLM - KorNAT-Harmless63.76Normalized accuracy (%)66.4
Open Korean LLM - Ko-Winogrande60.69Accuracy (%)56.6
Open Korean LLM - KorNAT-Helpful46.98Normalized accuracy (%)51.3
Open Korean LLM - Ko-GPQA-Diamond22.22Normalized accuracy (%)35

Interactive version: theaggregate.ai/model?slug=llama3-1-korean-v1-2-sft-by-aidx · How It Works · Data refreshed daily, snapshot 2026-09-19.