Translation Set1->en spBleu: leaderboard

spBLEU (SentencePiece BLEU) evaluation metric for machine translation quality assessment, using language-agnostic SentencePiece tokenization with BLEU scoring. Part of the FLORES-101 evaluation benchmark for low-resource and multilingual machine translation.

Metric: Set1→en spBLEU (imported). Source: www.amazon.science. Source: benchmarklist.com. 13 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 1.5 Pro (002)45.6#349
2Nova Pro44.4#569
3GPT-4o43.9#343
4Llama 3.2 90B43.7#596
5Claude 3.5 Sonnet43.5#350
6Nova Lite43.1#754
7Gemini 1.5 Flash (002)42.9#583
8Nova Micro42.6#898
9GPT-4o Mini41.9#599
10Gemini 1.5 Flash-8B (001)41.4#791
11Claude 3.5 Haiku40.2#568
12Llama 3.1 8B36.5#1151
13Llama 3.2 11B36.3#1199

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=translation-set1-over-en-spbleu · How It Works · Data refreshed daily, snapshot 2026-10-20.