ParaPairAudioBench - Rate: leaderboard
ParaPairAudioBench (Jeon et al., Interspeech 2026) tests audio language models as pairwise judges: given two recordings and a speech-generation instruction, the model picks the one that fulfils it better or declares a tie, and accuracy in percent is averaged over both presentation orders; higher is better. This board is 375 EARS pairs of the same sentence judged on which is slower or faster, with no ties, so chance is one half.
Metric: Pairwise judgment accuracy (%; mean of both A/B orders; 375 EARS pairs, faster or slower speech, no ties, chance 50). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Flash | 88.9 | #452 |
| 2 | Qwen2.5-Omni-7B | 61.9 | #1797 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=parapairaudiobench-rate · How It Works · Data refreshed daily, snapshot 2026-11-12.