STEB - Nonverbal Vocalization Preservation (English to Chinese): leaderboard

English to Chinese speech-to-speech translation on STEB, a 32.6-hour benchmark of real drama, audiobook, advertisement, interview, news and commentary speech (Cheng et al., 2026). Preservation of nonverbal vocalizations such as laughter (type, count, order and position) on the nonverbal-vocalization subset, on a 1-5 scale judged by Qwen3-30B-A3B; higher is better.

Metric: LLM-judged nonverbal-vocalization preservation (1-5): type, count, order and position of events such as laughter in the NV-marked transcripts of the source and the translated speech (BEATs event detection), scored three times by Qwen3-30B-A3B (outlier-aware aggregate); English-to-Chinese speech-to-speech translation of the NV subset's English source utterances. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=steb-nonverbal-vocalization-preservation-english-to-chinese · How It Works · Data refreshed daily, snapshot 2026-11-12.