MusTBENCH - Local Transition Recognition: leaderboard

Metric: Local Transition Recognition (LTR, 208 questions): multiple-choice accuracy (%) at picking the description of the musical transition at a given timestamp, with distractors from other transitions of the same song, on the MusTBench test set (full-length MTG-Jamendo and Slakh2100 tracks, music-expert-validated questions), zero-shot with the full track and a task instruction, temperature 0, unparseable timestamps and intervals counted wrong; higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 12 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro62.5
2Gemini 2.5 Flash56.7
3Gemini 3 Pro54.3
4Gemini 3 Flash51.4
5Qwen2.5-Omni-7B45.7
6Phi-4 Multimodal Instruct28.4

Interactive version: theaggregate.ai/benchmark?slug=mustbench-local-transition-recognition · How It Works · Data refreshed daily, snapshot 2026-10-07.