Open Korean LLM - Ko-Winogrande: leaderboard

Korean WinoGrande: two-option commonsense referent-resolution sentences provided by Flitto, scored by accuracy on a 0-100 scale (50 is chance); higher is better. From Upstage and NIA's Open Ko-LLM Leaderboard 2 (lm-evaluation-harness on private Korean test sets); frozen since its last evaluations in January 2025.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1158 models tracked.

Top models

#ModelScoreOverall rank
1Myrrh_solar_10.7b_3.076.09#1055
2nox-solar-10.7B-v473.88#1250
3free-solar-evo-v0.1373.56#1077
4free-solar-evo-v0.173.01#1152
5free-solar-evo-v0.1172.85#1144
6lambda-qwen2.5-14B-dpo-test71.03#481
7Rombos-LLM-V2.6-Qwen-14B70.24#520
8Qwen2.5-Lumen-14B70.24#482
9gemma-2-27B-it-SimPO-37K-100steps70.24#609
10mistral-nemo-wissenschaft-12B70.24#689
11gemma2-gutenberg-27B70.24#453
12Gemma 2 27B (IT)70.09#652
13SuperNova-Medius70.09#483
14Qwen2.5-14B-Gutenberg-1e-Delta69.93#473
15Mistral-Nemo-Instruct-2407-abliterated69.93#728

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-korean-llm-ko-winogrande · How It Works · Data refreshed daily, snapshot 2026-11-05.