Alexandria - Human Dialectness Rating (Saudi Arabic): leaderboard

Metric: Dialectness and fluency (1-5; native Saudi speakers rate whether the English-to-dialect translation sounds like a native speaker of the target dialect). Source: arxiv.org. Saturation forecast: Around March 2027. 6 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Preview) (Medium)4.63
2Gemini 3 Flash (Preview) (Minimal)4.55
3c4ai-command-a-03-20254.36
4Gemma 3 27B (IT)4.26
5GPT-OSS-120B4.15
6aya-expanse-32B3.26

Interactive version: theaggregate.ai/benchmark?slug=alexandria-human-dialectness-rating-saudi-arabic · How It Works · Data refreshed daily, snapshot 2026-09-26.