KMMAU - Role/Profession: leaderboard
The role or profession of a speaker, a four-way choice, on native Korean speech in KMMAU (Kim et al., 2026). Accuracy in percent; higher is better.
Metric: Accuracy (%; four-choice question on a speaker's role or profession; native Korean audio from KSS, KMSAV and the Seoul Corpus; single run at temperature 0.7). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Fun-Audio-Chat | 92 | |
| 2 | Step-Audio-2-mini | 83 | |
| 3 | Qwen2.5-Omni | 80 | #1499 |
| 4 | MiniCPM-o 4.5 | 78 | |
| 5 | Raon-Speech | 75 | |
| 6 | Audio Flamingo 3 | 69 | |
| 7 | HyperCLOVA X 8B Omni | 44 | |
| 8 | InteractiveOmni | 14 |
Interactive version: theaggregate.ai/benchmark?slug=kmmau-role-profession · How It Works · Data refreshed daily, snapshot 2026-11-12.