KoALa-Bench - PA-QA: leaderboard

KoALa-Bench (2026) evaluates large audio language models on Korean speech understanding and on faithfulness to the speech context, under clean and noisy audio. This board is accuracy in percent on long spoken stories with multiple-choice questions whose evidence sits at a known position, clean audio; higher is better.

Metric: Accuracy (%) on PA-QA, MCTest stories read as long Korean speech with multiple-choice questions whose evidence sits at a known position, all positions, Korean speech synthesized or recorded per item, clean audio (first value of each clean / noisy pair), mean over four prompts with greedy decoding; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen3 Omni 30B A3B Instruct92.51#928
2Gemini 2.5 Flash Lite92.31#972
3Voxtral-Mini-3B-250784.25#3545
4GPT-Audio Mini77.23#919
5Gemma 3n E4B (IT)48.7#2368
6Raon-Speech-9B40.98

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=koala-bench-pa-qa · How It Works · Data refreshed daily, snapshot 2026-11-22.