SEA-SpeechBench - Timestamped Content Query (60-120 s): leaderboard

Timestamped content query in SEA-SpeechBench (Liao et al., 2026): transcribe only what is said inside a given time window of a Southeast Asian recording lasting 60 to 120 seconds, with an English instruction prompt. Word or character error rate in percent, which can exceed 100; lower is better.

Metric: WER or CER (%; transcribe only the speech inside a queried time window of a long recording of 60-120 seconds, CER for languages without word boundaries; English instruction prompt; blank where the model cannot take audio of that length; can exceed 100; lower is better). Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScoreOverall rank
1Qwen3 Omni 30B A3B Instruct1.34#902
2Gemini 2.5 Flash9.44#452
3Qwen2.5-Omni-7B9.85#1797
4MERaLiON-2-3B11.27#6258
5Voxtral-Mini-3B-250712.86#3702
6MERaLiON-2-10B14.72#1646
7Phi-4 Multimodal Instruct16.25#3914

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sea-speechbench-timestamped-content-query-60-120-s · How It Works · Data refreshed daily, snapshot 2026-11-12.