SEA-SpeechBench - Speech Translation (SEA Prompt): leaderboard

Speech translation into English in SEA-SpeechBench (Liao et al., 2026), from short Southeast Asian speech clips, with the instruction written in the native Southeast Asian language. Corpus BLEU from 0 to 100; higher is better.

Metric: BLEU (0-100): corpus BLEU of the English translation of Southeast Asian speech; short clips of at most 30 s from curated public Southeast Asian speech corpora, up to 1,000 sampled items per dataset; instruction prompt in the native Southeast Asian language. Source: arxiv.org. Saturation forecast: Around 2028. 15 models tracked.

Top models

#ModelScoreOverall rank
1MERaLiON-2-10B19.52#1646
2Gemini 2.5 Flash18.89#452
3Voxtral-Mini-3B-250718.15#3702
4Gemma 3n E4B (IT)13.58#2220
5Qwen3 Omni 30B A3B Instruct13.55#902
6Gemma 3n E2B (IT)8.72#3758
7Qwen2.5-Omni-7B8.06#1797
8MERaLiON-2-3B7.42#6258
9Phi-4 Multimodal Instruct0.32#3914

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sea-speechbench-speech-translation-sea-prompt · How It Works · Data refreshed daily, snapshot 2026-11-12.