Open Korean LLM - KorNAT-Helpful: leaderboard

Ko-Helpfulness (KorNAT family, SELECTSTAR and KAIST AI): multiple-choice helpfulness items, scored by normalized accuracy on a 0-100 scale; higher is better. A perfect score with zero standard error is dropped as a harness artifact. From Upstage and NIA's Open Ko-LLM Leaderboard 2 (lm-evaluation-harness on private Korean test sets); frozen since its last evaluations in January 2025.

Metric: Normalized accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1157 models tracked.

Top models

#ModelScoreOverall rank
1Myrrh_solar_10.7b_3.082.13#1055
2free-solar-evo-v0.177.53#1152
3free-solar-evo-v0.1376.8#1077
4free-solar-evo-v0.1175.38#1144
5nox-solar-10.7B-v467.5#1250
6lambda-qwen2.5-14B-dpo-test66.4#481
7Qwen2.5-Lumen-14B60.9#482
8Qwen 2.5 14B Instruct60.65#654
9qwen2.5-reinstruct-alternate-lumen-14B60.48#445
10Qwen2.5-14B-Gutenberg-1e-Delta60.2#473
11Qwen2.5-14B-Gutenberg-Instruct-Slerpeno60.05#431
12Rombos-LLM-V2.6-Qwen-14B59.2#520
13SuperNova-Medius58.63#483
14Qwen2.5-7B-Instruct-abliterated56.28#792
15Llama-3-Base-8B-SFT-RDPO56.23#972

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-korean-llm-kornat-helpful · How It Works · Data refreshed daily, snapshot 2026-11-05.