TurkBench - Bias: leaderboard

TurkBench (METU NLP group and Turkcell, SIGTURK 2026) task: 250 expert-written multiple-choice items with ambiguous and disambiguated contexts testing reliance on social stereotypes (age, gender and similar themes) in Turkish. Accuracy 0-100, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 38 models tracked.

Top models

#ModelScoreOverall rank
1MiniMax-M291.4#327
2GLM-5 FP890#147
3GLM-4.688.6#265
4Qwen 3.5 122B A10B88.4#184
5Qwen 3.5 397B A17B87.4#154
6Qwen 3.5 27B86.2#192
7MiniMax-M2.586#316
8Qwen 3.5 35B A3B85.4#268
9Step 3.5 Flash85.2#281
10DeepSeek V3.2 Exp84#241
11GPT-OSS-120B82.8#346
12Qwen 2.5 14B Instruct82.8#654
13GLM-4.7 Flash81#543
14Gemma 3 27B (IT)80.13#528
15DeepSeek V3.179.6#275

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=turkbench-bias · How It Works · Data refreshed daily, snapshot 2026-11-05.