Alexandria - English to Saudi Arabic (Single Turn, No Metadata): leaderboard
English to Saudi Arabic translation of single conversation turns from the Alexandria (El Mekki et al., ACL 2026) public test set, a human-translated multi-domain dialect corpus, with no speaker metadata in the prompt. spBLEU on a 0-100 scale (FLORES-200 SentencePiece tokenizer), higher is better.
Metric: spBLEU (0-100; SacreBLEU with the FLORES-200 SentencePiece tokenizer; single English turns of the Alexandria public test set translated into Saudi Arabic with no speaker metadata in the prompt). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | c4ai-command-a-03-2025 | 28.88 | #1096 |
| 2 | Gemma 3 12B (IT) | 25.65 | #1849 |
| 3 | aya-expanse-32B | 23.54 | #1950 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=alexandria-english-to-saudi-arabic-single-turn-no-metadata · How It Works · Data refreshed daily, snapshot 2026-11-12.