Open Korean LLM - KorNAT-CKA: leaderboard

KorNAT common knowledge alignment (CKA, by SELECTSTAR and KAIST AI): multiple-choice questions on the general knowledge taught in Korean schools, scored by normalized accuracy on a 0-100 scale; higher is better. From Upstage and NIA's Open Ko-LLM Leaderboard 2 (lm-evaluation-harness on private Korean test sets); frozen since its last evaluations in January 2025.

Metric: Normalized accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1158 models tracked.

Top models

#ModelScoreOverall rank
1Myrrh_solar_10.7b_3.048.57#1055
2lambda-qwen2.5-14B-dpo-test46.25#481
3Qwen2.5-Lumen-14B40.1#482
4Qwen2.5-14B-Gutenberg-Instruct-Slerpeno39.85#431
5free-solar-evo-v0.1339.81#1077
6Qwen2.5-14B-Gutenberg-1e-Delta39.68#473
7qwen2.5-reinstruct-alternate-lumen-14B39.66#445
8Qwen 2.5 14B Instruct39.56#654
9recoilme-gemma-2-9B-v0.439.31#574
10Rombos-LLM-V2.6-Qwen-14B39.21#520
11NeuralSynthesis-7B-v0.138.9#973
12free-solar-evo-v0.1138.47#1144
13gemma2-gutenberg-27B38.05#453
14SuperNova-Medius37.8#483
15Gemma 2 27B (IT)37.57#652

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-korean-llm-kornat-cka · How It Works · Data refreshed daily, snapshot 2026-11-05.