KVoiceBench - KAlpacaEval: leaderboard
Spoken Korean open-ended instructions transferred from AlpacaEval, also part of KOpenAudioBench, part of KVoiceBench (Kim et al., 2026). GPT-5.4 judge score on a 0-100 scale over 614 TTS-synthesized items; higher is better.
Metric: GPT-5.4 judge score (0-100; open-ended instructions transferred from AlpacaEval; the same score enters the KOpenAudioBench mean; Korean spoken questions synthesized with TTS; single run at temperature 0.7). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Raon-Speech | 65 | |
| 2 | Fun-Audio-Chat | 61.4 | |
| 3 | Qwen2.5-Omni | 56 | #1499 |
| 4 | HyperCLOVA X 8B Omni | 54.8 | |
| 5 | MiniCPM-o 4.5 | 51.6 | |
| 6 | Step-Audio-2-mini | 43.4 | |
| 7 | Audio Flamingo 3 | 29.4 | |
| 8 | InteractiveOmni | 26.8 |
Interactive version: theaggregate.ai/benchmark?slug=kvoicebench-kalpacaeval · How It Works · Data refreshed daily, snapshot 2026-11-12.