IHBench - Recovery Quality - Pushback: leaderboard

Metric: Recovery pass rate (%; 105 pushbacks, every type-specific criterion met, GPT-5.4-mini judge (high reasoning), audio input, mean of three epochs). Source: arxiv.org. Saturation forecast: Around December 2026. 27 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash (Thinking)75
2GPT Audio74
3Gemini 3.1 Pro (Preview)71
4GPT-4o Audio71
5GPT Audio Mini71
6Qwen3 Omni 30B A3B Instruct69
7Gemini 2.5 Flash (Non-reasoning)67
8Gemini 2.5 Pro66
9Voxtral-Small-24B-250761
10Gemma 4 12B (Non-reasoning)60
11Gemma 4 12B (Reasoning)58
12Qwen2.5-Omni-7B49
13Phi-4 Multimodal Instruct44
14Qwen2-Audio-7B-Instruct30

Interactive version: theaggregate.ai/benchmark?slug=ihbench-recovery-quality-pushback · How It Works · Data refreshed daily, snapshot 2026-09-26.