TurkBench - Reading Comprehension: leaderboard

TurkBench (METU NLP group and Turkcell, SIGTURK 2026) task: 482 open-ended questions answered from Turkish sociology texts, graded by an LLM judge (0-100, higher is better).

Metric: LLM-as-a-judge score (0-100). Source: huggingface.co. Saturation forecast: Estimated already saturated. 38 models tracked.

Top models

#ModelScoreOverall rank
1GPT-OSS-120B96.13#346
2MiniMax-M2.595.41#316
3DeepSeek V3.195.06#275
4MiMo-V2-Flash94.94#378
5Step 3.5 Flash94.92#281
6DeepSeek V3.2 Exp94.59#241
7GLM-5 FP894.47#147
8Qwen 3.5 122B A10B94.43#184
9Qwen 3 Next 80B A3B Instruct94.43#381
10Qwen 3.5 27B94.34#192
11Qwen 3.5 35B A3B94.12#268
12GLM-4.694.02#265
13Qwen 3.5 397B A17B93.89#154
14Qwen 3 32B92.99#449
15Gemma 3 27B (IT)92.97#528

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=turkbench-reading-comprehension · How It Works · Data refreshed daily, snapshot 2026-11-05.