BASS - Artist Counting: leaderboard
Metric: Exact-match accuracy (%) on the 229 artist counting questions: count credited, featured, rapping or singing artists in a song, a section or a time range (free-form answers); BASS music understanding benchmark, audio language models get a text prompt (one of ten paraphrases) and a full commercial music recording from BASS's songs; raw score before chance normalization; higher is better. Source: arxiv.org. Saturation forecast: Around 2036. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | SALMONN-7B | 27.32 | #1274 |
| 2 | Gemini 2.5 Pro | 25.77 | #145 |
| 3 | Phi-4 Multimodal Instruct | 23.59 | #896 |
| 4 | Voxtral-Small-24B-2507 | 9.09 | #565 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=bass-artist-counting · How It Works · Data refreshed daily, snapshot 2026-10-11.