SEA-SpeechBench - Temporal Localization (30-60 s): leaderboard

Temporal localization in SEA-SpeechBench (Liao et al., 2026): give the start and end time at which a queried phrase is spoken in a Southeast Asian recording lasting 30 to 60 seconds, with an English instruction prompt. Span-overlap F1 in percent; higher is better.

Metric: Span-overlap F1 (%; predict the start and end time at which a queried phrase is spoken in a recording of 30-60 seconds; English instruction prompt; blank where the model cannot take audio of that length). Source: arxiv.org. Saturation forecast: Not forecast. 13 models tracked.

Top models

#ModelScoreOverall rank
1Qwen2.5-Omni-7B19.98#1797
2MERaLiON-2-10B12.37#1646
3MERaLiON-2-3B10.28#6258
4Voxtral-Mini-3B-25079.87#3702
5Gemma 3n E4B (IT)8.72#2220
6Gemma 3n E2B (IT)8.27#3758
7Gemini 2.5 Flash7.7#452
8Phi-4 Multimodal Instruct6.25#3914
9Qwen3 Omni 30B A3B Instruct5.9#902

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sea-speechbench-temporal-localization-30-60-s · How It Works · Data refreshed daily, snapshot 2026-11-12.