Alexandria - English to Lebanese Arabic (Single Turn, Full Metadata): leaderboard
Metric: spBLEU (0-100; SacreBLEU with the FLORES-200 SentencePiece tokenizer; single English turns of the Alexandria public test set translated into Lebanese Arabic with the full persona, role and gender metadata in the prompt). Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | c4ai-command-a-03-2025 | 21.13 |
| 2 | Gemma 3 12B (IT) | 20.96 |
| 3 | aya-expanse-32B | 14.51 |
Interactive version: theaggregate.ai/benchmark?slug=alexandria-english-to-lebanese-arabic-single-turn-full-metadata · How It Works · Data refreshed daily, snapshot 2026-09-26.