STEB - Emotion Preservation (Chinese to English): leaderboard

Chinese to English speech-to-speech translation on STEB, a 32.6-hour benchmark of real drama, audiobook, advertisement, interview, news and commentary speech (Cheng et al., 2026). Emotion consistency between source and translated speech on a 1-5 scale, judged by Qwen3-30B-A3B from Qwen3-Omni-Captioner descriptions of both; higher is better.

Metric: LLM-judged emotion consistency (1-5) of category, intensity and attitude between the source and the translated speech: both are captioned by Qwen3-Omni-Captioner and summarized by Qwen3-30B-A3B, which scores the pair three times (outlier-aware aggregate); Chinese-to-English speech-to-speech translation of the normal subset's Chinese source utterances. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.

Top models

#ModelScoreOverall rank
1UniSS3.61
2Step-Audio-23.57
3Seed LiveInterpret 2.03.34
4SeamlessExpressive3.1

Interactive version: theaggregate.ai/benchmark?slug=steb-emotion-preservation-chinese-to-english · How It Works · Data refreshed daily, snapshot 2026-11-12.