Jamendo-MT-QA - Yes-No Questions: leaderboard

Jamendo-MT-QA (2026) asks comparative questions about pairs of music tracks from Jamendo; models that take two audio inputs answer end to end on a 2,010-pair subset. This board covers the yes/no questions, scored by rule-based matching. Accuracy in percent; higher is better.

Metric: Accuracy (%) on comparative yes/no questions about two music tracks, rule-based answer matching; the 2,010-pair random subset on which every multi-audio model ran; each model hears both tracks and the question end to end; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-4o-mini-Audio77.3#1795
2GPT-4o Audio69.6#1129
3Qwen3-Omni59.7#1055
4Jamendo-MT-QA Qwen2-Audio (checkpoint unspecified)34.4

Interactive version: theaggregate.ai/benchmark?slug=jamendo-mt-qa-yes-no-questions · How It Works · Data refreshed daily, snapshot 2026-11-21.