DITING - Terminology Localization: leaderboard

DITING subtask measuring consistent, context-appropriate localization of domain and setting-specific terminology.

Metric: Score. Source: huggingface.co. Saturation forecast: Estimated already saturated. 14 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V35.12#321
2GPT-4o4.54#343
3Seed-X-PPO-7B4.52#575
4Qwen 3 14B4.12#537
5Qwen 3 32B4#443
6Llama 3 70B3.64#631
7Qwen 3 8B3.32#674
8Llama 3 8B2.7#1242

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=diting-terminology-localization · How It Works · Data refreshed daily, snapshot 2026-10-20.