IHBench - Recovery Quality - Impatient: leaderboard

Metric: Recovery pass rate (%; 84 impatient interruptions, every type-specific criterion met, GPT-5.4-mini judge (high reasoning), audio input, mean of three epochs). Source: arxiv.org. Saturation forecast: Around June 2028. 27 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro69
2Gemini 3.1 Pro (Preview)66
3GPT-4o Audio64
4Qwen3 Omni 30B A3B Instruct63
5Gemini 2.5 Flash (Non-reasoning)58
6Gemini 2.5 Flash (Thinking)58
7Phi-4 Multimodal Instruct56
8GPT Audio54
9Qwen2.5-Omni-7B53
10Voxtral-Small-24B-250753
11Gemma 4 12B (Reasoning)52
12Gemma 4 12B (Non-reasoning)51
13GPT Audio Mini48
14Qwen2-Audio-7B-Instruct44

Interactive version: theaggregate.ai/benchmark?slug=ihbench-recovery-quality-impatient · How It Works · Data refreshed daily, snapshot 2026-09-26.