KorT - Korean-English Translation: leaderboard

KorT (kort.worldsw.dev): about 100 private bidirectional Korean-English items across 28 phenomenon types. Every pair of system outputs is compared in both orders by GPT-5.6 Sol and Gemini 3.1 Pro judges with a reference, fitted to Bradley-Terry Elo. Higher is better; Elo is relative within this record. Commercial and research MT engines are excluded.

Metric: Elo (pairwise LLM-judged). Source: kort.worldsw.dev. Saturation forecast: Around July 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.6 Luna1201.8#79
2Gemini 3.6 Flash1179.3#57
3GPT-5.6 Terra1178.8#40
4Gemini 3.7 Flash1141.3#24
5Gemini 3.1 Pro (Preview)1132.3#64
6GLM-5.21119.1#80
7GPT-5.4 Mini1114.5#228
8Nemotron 3 Ultra1103.7#245
9DeepSeek V4 Pro (0813)1101.7#58
10DeepSeek V4 Flash (0731)1096.1#84
11Gemini 3.5 Flash Lite1072#174
12MiniMax-M31040.5#151
13Gemma 4 31B1034.4#212
14Nemotron 3 Super950.2#344
15GPT-OSS-120B926.3#346

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=kort-korean-english-translation · How It Works · Data refreshed daily, snapshot 2026-11-05.