MCGA - ASR - Wen: leaderboard

Speech recognition of 200 recorded classical wen prose read by native Mandarin speakers (MCGA test set; Du et al., Harbin Institute of Technology, 2026). Character error rate in percent against the original text; lower is better. The authors' Qwen-Omni-MCGA row is a LoRA fine-tune of Qwen2.5-Omni-7B on the MCGA training split.

Metric: Character error rate (%; 200 recorded wen prose passages of the test set). Source: arxiv.org. Saturation forecast: Around November 2026. 11 models tracked.

Top models

#ModelScoreOverall rank
1Qwen3 Omni 30B A3B Instruct4.3#902
2Gemini 3 Flash6.1#159
3Qwen2.5-Omni-7B8.8#1797
4Voxtral-Small-24B-250728.4#1291
5Voxtral-Mini-3B-250728.9#3702
6Phi-4 Multimodal Instruct51.1#3914

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=mcga-asr-wen · How It Works · Data refreshed daily, snapshot 2026-11-12.