KoALa-Bench - SIF Vicuna: leaderboard
KoALa-Bench (2026) evaluates large audio language models on Korean speech understanding and on faithfulness to the speech context, under clean and noisy audio. This board is the GPT-4o-judged instruction-following score, on a 0 to 100 scale, for spoken Korean Vicuna instructions, clean audio; higher is better.
Metric: Speech instruction-following score (GPT-4o judge returning 0-1 against the reference answer, x100) on the Korean spoken Vicuna instructions, Korean speech synthesized or recorded per item, clean audio (first value of each clean / noisy pair), mean over four prompts with greedy decoding; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-Audio Mini | 82.14 | #918 |
| 2 | Gemma 3n E4B (IT) | 79.38 | #2401 |
| 3 | Qwen3 Omni 30B A3B Instruct | 76.5 | #930 |
| 4 | Gemini 2.5 Flash Lite | 76.43 | #964 |
| 5 | Raon-Speech-9B | 73.81 | |
| 6 | Voxtral-Mini-3B-2507 | 62.82 | #3682 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=koala-bench-sif-vicuna · How It Works · Data refreshed daily, snapshot 2026-11-21.