SeaEval - FLORES Translation - Chinese-to-English (Zero-Shot): leaderboard

SeaEval zero-shot Chinese-to-English translation evaluation measuring BLEU quality for translation into English.

Metric: BLEU (0-100). Source: huggingface.co. Saturation forecast: Estimated already saturated. 24 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 72B Instruct28.43#454
2Llama 3.1 70B Instruct28.33#561
3Llama 3.1 70B Cpt Sea Lionv3 Instruct27.86#548
4Qwen 2.5 32B Instruct26.92#498
5Gemma 2 9B (IT)26.75#788
6Qwen 2.5 14B Instruct26.28#647
7SeaLLMs-v3-7B-Chat25.17#915
8gemma2-9B-cpt-sea-lionv3-instruct25.11#705
9Llama 3 70B Instruct24.4#634
10Qwen 2.5 7B Instruct24.37#862
11Llama 3.1 8B Instruct24.29#1035
12Qwen 2 72B Instruct23.89#576
13Llama 3 8B Cpt Sea Lionv2 Instruct23.82#1188
14Llama 3 8B Cpt Sea Lionv2.1 Instruct23.78#1024
15Qwen 2.5 3B Instruct22.45#1162

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=seaeval-flores-translation-chinese-to-english-zero-shot · How It Works · Data refreshed daily, snapshot 2026-10-20.