KVoiceBench: leaderboard

Korean spoken question answering from KVoiceBench (Kim et al., 2026): 7,306 items transferred from VoiceBench with ground-truth correction, Korean redesign of language-specific items, speech-friendly normalization and TTS synthesis. Mean of nine sub-benchmark scores on a 0-100 scale (accuracy, GPT-5.4 judge scores, instruction-following accuracy and refusal rate); higher is better.

Metric: Mean of the nine sub-benchmark scores (each on 0-100 under its source metric: accuracy, GPT-5.4 judge score, instruction-following accuracy or refusal rate; 7,306 Korean spoken samples transferred from VoiceBench; single run at temperature 0.7). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScoreOverall rank
1Raon-Speech66.6
2Fun-Audio-Chat50.1
3Qwen2.5-Omni49#1499
4HyperCLOVA X 8B Omni45.1
5MiniCPM-o 4.539.5
6Step-Audio-2-mini32
7InteractiveOmni20
8Audio Flamingo 318.8

Interactive version: theaggregate.ai/benchmark?slug=kvoicebench · How It Works · Data refreshed daily, snapshot 2026-11-12.