BASS - Full Structural Lyric Transcription: leaderboard
Metric: Word error rate (a ratio, not a percentage; 0 is perfect and insertions leave it unbounded above, averaged over matched sections) for transcribing the lyrics of every listed section of a song (Intro, Verse, Chorus, Bridge, Outro and others) against Genius reference lyrics; audio language models get a text prompt (one of ten paraphrases) and a full commercial music recording from BASS's songs; free-form answers; lower is better. Source: arxiv.org. Saturation forecast: Around October 2026. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 1.35 | #145 |
| 2 | Voxtral-Small-24B-2507 | 2.78 | #565 |
| 3 | SALMONN-7B | 7.61 | #1274 |
| 4 | Phi-4 Multimodal Instruct | 79.29 | #896 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=bass-full-structural-lyric-transcription · How It Works · Data refreshed daily, snapshot 2026-10-11.