VocalGrad - Sine-Wave Ablation - Volume: leaderboard
VocalGrad (2026), 21,600 binary acoustic-change questions across nine transformations; case-insensitive whole-word direction parsing with exactly one direction required; invalid outputs fail. Gemini 3 Flash uses low thinking and temperature 1; MiMo temperature 0.3/top-p 0.95; other open models greedy where available. Main model runs use the complete dataset, not the differently sampled six-person human study The ablation uses synthetic sine waves in four supported transformations. Accuracy (%); higher is better.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi-Audio | 57.5 | |
| 2 | MiMo-Audio | 55.8 | |
| 3 | Gemini 3 Flash (Low) | 50 | #99 (Gemini 3 Flash) |
| 4 | Step-Audio 2 mini | 50 | |
| 5 | Audio Flamingo 3 | 50 |
Interactive version: theaggregate.ai/benchmark?slug=vocalgrad-sine-wave-ablation-volume · How It Works · Data refreshed daily, snapshot 2026-10-20.