MERA Multi - ruTiE-Audio: leaderboard

MERA Multi task ruTiE-Audio: a private-test Russian audio benchmark of multi-turn dialogue questions that refer to audio, scored by MERA's task metric (Exact Match or judge score). MERA's 0-1 result scaled to 0-100; higher is better. From the MERA Multi leaderboard (AI Alliance Russia); only submissions MERA shows publicly for the modality are included.

Metric: Score (%). Source: mera.a-ai.ru. Saturation forecast: Around February 2027. 23 models tracked.

Top models

#ModelScoreOverall rank
1Voxtral-Small-24B-250748.8#593
2Qwen3 Omni 30B A3B Instruct43.5#401
3Qwen2.5-Omni-7B38.5#633
4gemma-4-E4B-it36.1#577
5Gemma 4 E2B (IT)19.7#779
6Phi-4 Multimodal Instruct10.4#922

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mera-multi-rutie-audio · How It Works · Data refreshed daily, snapshot 2026-11-05.