Korean LLM Eval - KMMLU-HARD: leaderboard

daekeun-ml Korean proficiency suite on the KMMLU-HARD subset: overall accuracy % on the hardest KMMLU questions, 0-shot.

Metric: Accuracy (%, 0-shot). Source: github.com. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5 (Medium)88.4#16 (Claude Opus 5)
2GPT-5.6 Sol (Medium)85.04#22 (GPT-5.6 Sol)
3GPT-5.6 Terra (Medium)77.86#40 (GPT-5.6 Terra)
4Claude Sonnet 5 (Medium)77.44#65 (Claude Sonnet 5)
5GPT-5.6 Luna (Medium)75.76#79 (GPT-5.6 Luna)
6DeepSeek V4 Flash (0731) (High)74.2#84 (DeepSeek V4 Flash (0731))
7DeepSeek V4 Flash (0731) (Max)74#84 (DeepSeek V4 Flash (0731))

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=korean-llm-eval-kmmlu-hard · How It Works · Data refreshed daily, snapshot 2026-11-05.