Alexandria - English to Lebanese Arabic (Single Turn, No Metadata): leaderboard

Metric: spBLEU (0-100; SacreBLEU with the FLORES-200 SentencePiece tokenizer; single English turns of the Alexandria public test set translated into Lebanese Arabic with no speaker metadata in the prompt). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.

Top models

#ModelScore
1Gemma 3 12B (IT)20.82
2c4ai-command-a-03-202520.2
3aya-expanse-32B19.77

Interactive version: theaggregate.ai/benchmark?slug=alexandria-english-to-lebanese-arabic-single-turn-no-metadata · How It Works · Data refreshed daily, snapshot 2026-09-26.