KoALa-Bench - SIF KUDGE: leaderboard
KoALa-Bench (2026) evaluates large audio language models on Korean speech understanding and on faithfulness to the speech context, under clean and noisy audio. This board is the GPT-4o-judged instruction-following score, on a 0 to 100 scale, for spoken Korean KUDGE instructions, clean audio; higher is better.
Metric: Speech instruction-following score (GPT-4o judge returning 0-1 against the reference answer, x100) on the Korean spoken KUDGE instructions, Korean speech synthesized or recorded per item, clean audio (first value of each clean / noisy pair), mean over four prompts with greedy decoding; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-Audio Mini | 74.07 | #919 |
| 2 | Qwen3 Omni 30B A3B Instruct | 70.89 | #928 |
| 3 | Gemma 3n E4B (IT) | 70.68 | #2368 |
| 4 | Gemini 2.5 Flash Lite | 70.29 | #972 |
| 5 | Raon-Speech-9B | 68.35 | |
| 6 | Voxtral-Mini-3B-2507 | 59.14 | #3545 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=koala-bench-sif-kudge · How It Works · Data refreshed daily, snapshot 2026-11-22.