KoALa-Bench - SIF Alpaca: leaderboard
Metric: Speech instruction-following score (GPT-4o judge returning 0-1 against the reference answer, x100) on the Korean spoken Alpaca instructions, Korean speech synthesized or recorded per item, clean audio (first value of each clean / noisy pair), mean over four prompts with greedy decoding; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash Lite | 85.94 |
| 2 | Gemma 3n E4B (IT) | 82.83 |
| 3 | Qwen3 Omni 30B A3B Instruct | 82.55 |
| 4 | Voxtral-Mini-3B-2507 | 68.48 |
Interactive version: theaggregate.ai/benchmark?slug=koala-bench-sif-alpaca · How It Works · Data refreshed daily, snapshot 2026-10-07.