Spark-Audio 1.0 - In-house 202-Dialect corpus: leaderboard

Spark-Audio 1.0 release checkpoint after its second distillation epoch. Native audio-to-text and text evaluations use each task’s published metric. In-house recognition and spoken interaction use separate in-house populations. IFEval and IFBench measure instruction-level accuracy; HumanEval measures pass@1. Encoder adaptation ablations are separate from the released model. CER (%).

Metric: CER (%). Source: arxiv.org. Saturation forecast: Around January 2028. 3 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 Omni Plus19.79#104
2Qwen3.5 Omni Flash20.53#202

No result here: #5 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=spark-audio-1-0-in-house-202-dialect-corpus · How It Works · Data refreshed daily, snapshot 2026-10-25.