TurkBench - Turkish Vocabulary: leaderboard

TurkBench (METU NLP group and Turkcell, SIGTURK 2026) task: Multiple-choice synonym questions on rare Turkish words (139) and on native Turkish equivalents of loan words (165). Accuracy 0-100, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 38 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 122B A10B98#184
2Qwen 3.5 397B A17B97#154
3MiniMax-M2.596#316
4GLM-4.696#265
5Qwen 3.5 35B A3B95#268
6Qwen 3.5 27B94#192
7DeepSeek V3.2 Exp94#241
8DeepSeek V3.193#275
9GLM-5 FP893#147
10MiMo-V2-Flash92#378
11Gemma 3 12B (IT)91#672
12Gemma 3 27B (IT)90#528
13Qwen 3 30B A3B 2507 Instruct89#492
14MiniMax-M289#327
15GLM-4.7 Flash88#543

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=turkbench-turkish-vocabulary · How It Works · Data refreshed daily, snapshot 2026-11-05.