SeaEval - FLORES Translation - Malay-to-English (Zero-Shot) — leaderboard

Metric: BLEU (0-100). Source: huggingface.co. 24 models tracked.

Top models

#ModelScore
1Llama 3.1 70B Instruct44.62
2Qwen 2.5 72B Instruct42.38
3Gemma 2 9B (IT)42.34
4Qwen 2 72B Instruct40.8
5Qwen 2.5 32B Instruct40.31
6Llama 3 70B Instruct39.57
7Llama 3 8B Cpt Sea Lionv2.1 Instruct39.04
8Qwen 2.5 14B Instruct38.41
9Llama 3.1 8B Instruct36.58
10SeaLLMs-v3-7B-Chat34.84
11Qwen 2.5 7B Instruct34.66
12Gemma 2 2B (IT)33.74
13Llama 3 8B Instruct31.63
14Sailor2-8B-Chat31.39
15Qwen 2.5 3B Instruct31.06

Interactive version: theaggregate.ai/benchmark?slug=seaeval-flores-translation-malay-to-english-zero-shot · How the rankings work · Data refreshed daily, snapshot 2026-07-22.