Kimi-ASR Internal Testset - Subset 1: leaderboard
Five audio language models transcribe subset 1 of Moonshot's unreleased in-house ASR test set (language and size not stated); the number is word error rate, lower is better. Unlike LibriSpeech or AISHELL nobody outside Moonshot can run it: Moonshot ran all five models itself with Kimi-Audio-Evalkit for the Kimi-Audio report (2025).
Metric: WER (%), lower is better, Moonshot's internal ASR test set subset 1, Kimi-Audio-Evalkit. Source: raw.githubusercontent.com. Saturation forecast: Rough model projection: around 2026. 5 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi-Audio-7B-Instruct | 1.42 | #1517 |
| 2 | Qwen2.5-Omni-7B | 1.53 | #1883 |
| 3 | Qwen2-Audio-7B | 2.31 | |
| 4 | Step-Audio-Chat | 2.82 | |
| 5 | Baichuan-Audio-Base | 3.41 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=kimi-asr-internal-testset-subset-1 · How It Works · Data refreshed daily, snapshot 2026-11-17.