IHBench - Recovery Quality - Topic Switch: leaderboard

Metric: Recovery pass rate (%; 73 topic switches, every type-specific criterion met, GPT-5.4-mini judge (high reasoning), audio input, mean of three epochs). Source: arxiv.org. Saturation forecast: Around December 2026. 27 models tracked.

Top models

#ModelScore
1GPT-4o Audio85
2Gemini 3.1 Pro (Preview)82
3Qwen3 Omni 30B A3B Instruct80
4Gemini 2.5 Flash (Thinking)78
5Gemini 2.5 Pro77
6Gemini 2.5 Flash (Non-reasoning)77
7GPT Audio77
8Voxtral-Small-24B-250770
9Gemma 4 12B (Reasoning)70
10Gemma 4 12B (Non-reasoning)67
11Qwen2.5-Omni-7B66
12GPT Audio Mini65
13Phi-4 Multimodal Instruct63
14Qwen2-Audio-7B-Instruct58

Interactive version: theaggregate.ai/benchmark?slug=ihbench-recovery-quality-topic-switch · How It Works · Data refreshed daily, snapshot 2026-09-26.