IHBench - Recovery Quality - Filler: leaderboard

Metric: Recovery pass rate (%; 60 backchannel fillers, where the turn should resume from the cut-off point, every type-specific criterion met, GPT-5.4-mini judge (high reasoning), audio input, mean of three epochs). Source: arxiv.org. Saturation forecast: Around February 2028. 27 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash (Thinking)68
2Gemini 2.5 Flash (Non-reasoning)64
3Gemini 2.5 Pro62
4Qwen3 Omni 30B A3B Instruct46
5Voxtral-Small-24B-250736
6Qwen2.5-Omni-7B35
7Gemma 4 12B (Reasoning)25
8Gemma 4 12B (Non-reasoning)22
9GPT Audio22
10Phi-4 Multimodal Instruct18
11Qwen2-Audio-7B-Instruct14
12Gemini 3.1 Pro (Preview)13
13GPT-4o Audio8
14GPT Audio Mini8

Interactive version: theaggregate.ai/benchmark?slug=ihbench-recovery-quality-filler · How It Works · Data refreshed daily, snapshot 2026-09-26.