SEABED - Prosodic Ambiguity (Multiple-Choice): leaderboard
SEABED (Rajgarhia et al., 2026) is an audio-first reasoning benchmark on Southeast Asian speech built from openly available corpora. In this task the model resolves structurally ambiguous Indonesian sentences whose intended reading is fixed only by the prosody of the speaker; multiple-choice items with ten options are scored by exact match, and the score is accuracy in percent, higher is better.
Metric: Accuracy (%; 504 prosodic ambiguity resolution of structurally ambiguous Indonesian sentences items; multiple-choice items scored by exact match against the shuffled gold option; audio at 16 kHz). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.6 Flash | 60.7 | #72 |
| 2 | Gemini 3.5 Flash | 60.5 | #98 |
| 3 | Gemini 2.5 Pro | 47.6 | #262 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=seabed-prosodic-ambiguity-multiple-choice · How It Works · Data refreshed daily, snapshot 2026-11-12.