SEAL - AudioMultiChallenge - Text Output: leaderboard

Audio-in, text-out variant serving as baseline for how well models understand real human speech across multi-turn conversational tasks.

Metric: Score. Source: scale.com. Saturation forecast: Around October 2027. 21 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.8 Flash (High)60.4#21 (Gemini 3.8 Flash)
2Gemini 4 Argon (High)58.41#8 (Gemini 4 Argon)
3Inkling Small54.87#138
4Gemini 2.5 Pro (Thinking)46.9#152 (Gemini 2.5 Pro)
5Gemini 2.5 Flash (Thinking)40.04#245 (Gemini 2.5 Flash)
6Voxtral-Small-24B-250726.33#581
7Gemini 2.5 Flash26.11#245
8Phi-4 Multimodal Instruct15.49#906
9Gemma 3n E4B (IT)15.49#749
10Qwen2.5-Omni-7B11.95#624

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=seal-audiomultichallenge-text-output · How It Works · Data refreshed daily, snapshot 2026-10-20.