SEA-SpeechBench - Timestamped Content Query (120-180 s): leaderboard

Timestamped content query in SEA-SpeechBench (Liao et al., 2026): transcribe only what is said inside a given time window of a Southeast Asian recording lasting 120 to 180 seconds, with an English instruction prompt. Word or character error rate in percent, which can exceed 100; lower is better.

Metric: WER or CER (%; transcribe only the speech inside a queried time window of a long recording of 120-180 seconds, CER for languages without word boundaries; English instruction prompt; blank where the model cannot take audio of that length; can exceed 100; lower is better). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.

Top models

#ModelScoreOverall rank
1Qwen3 Omni 30B A3B Instruct1.86#902
2Gemini 2.5 Flash4.09#452
3MERaLiON-2-10B17.67#1646
4Voxtral-Mini-3B-250722.13#3702

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sea-speechbench-timestamped-content-query-120-180-s · How It Works · Data refreshed daily, snapshot 2026-11-12.