SpeechEditBench - Content: leaderboard

Metric: Joint success (%): the requested edit is applied (task-specific automatic check) and the linguistic content is preserved (Whisper large-v3 or Paraformer transcript within 10% WER or CER of the expected text); source speech plus a natural-language instruction, English and Mandarin samples, each model through its released editing or conversation interface; content editing (replace, insert or delete a word or phrase; the target span must appear in or vanish from the ASR transcript, so joint success equals edit success), 600 samples; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.

Top models

#ModelScore
1Qwen3 Omni 30B A3B Instruct72

Interactive version: theaggregate.ai/benchmark?slug=speecheditbench-content · How It Works · Data refreshed daily, snapshot 2026-09-29.