Spark-Audio 1.0 - Text HumanEval: leaderboard

Spark-Audio 1.0 release checkpoint after its second distillation epoch. Native audio-to-text and text evaluations use each task’s published metric. In-house recognition and spoken interaction use separate in-house populations. IFEval and IFBench measure instruction-level accuracy; HumanEval measures pass@1. Encoder adaptation ablations are separate from the released model. pass@1 (%).

Metric: pass@1 (%). Source: arxiv.org. Saturation forecast: Around January 2027. 2 models tracked.

Top models

#ModelScoreOverall rank
1Qwen3.5 Omni Flash89.02#202

No result here: #5 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=spark-audio-1-0-text-humaneval · How It Works · Data refreshed daily, snapshot 2026-10-25.