KoALa-Bench - SIF Vicuna: leaderboard

KoALa-Bench (2026) evaluates large audio language models on Korean speech understanding and on faithfulness to the speech context, under clean and noisy audio. This board is the GPT-4o-judged instruction-following score, on a 0 to 100 scale, for spoken Korean Vicuna instructions, clean audio; higher is better.

Metric: Speech instruction-following score (GPT-4o judge returning 0-1 against the reference answer, x100) on the Korean spoken Vicuna instructions, Korean speech synthesized or recorded per item, clean audio (first value of each clean / noisy pair), mean over four prompts with greedy decoding; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-Audio Mini82.14#918
2Gemma 3n E4B (IT)79.38#2401
3Qwen3 Omni 30B A3B Instruct76.5#930
4Gemini 2.5 Flash Lite76.43#964
5Raon-Speech-9B73.81
6Voxtral-Mini-3B-250762.82#3682

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=koala-bench-sif-vicuna · How It Works · Data refreshed daily, snapshot 2026-11-21.