Phi-4 Multimodal Instruct: benchmark results

Microsoft's Phi-4-multimodal-instruct, a lightweight multimodal model processing text, image and audio inputs to text output, with 128K context and SFT, DPO and RLHF alignment. Provider: Microsoft. Released 2025-02-26. Access: Open.

Aggregate Rating 1466 ± 6, rank #906 of 1656 rated models, from 580 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AVI-Bench - Audio-Referenced Visual Hallucination86.8Task score (%) on audio-referenced visual hallucination (250100
AppTek Call-Center Dialogues - Indian English9.4Word error rate (%) on the Indian-accented English (en_IN) c100
AudioBench - AISHELL ASR ZH WER7.47WER (%) (lower is better)100
AudioBench - CoVoST2 EN-ZH BLEU45.3Mean Score (%)100
AudioBench - CoVoST2 ZH-EN BLEU22.68Mean Score (%)100
AudioBench - LibriSpeech Clean WER1.68WER (%) (lower is better)100
AudioBench - MMAU Music68.86Score (%)100
AudioBench - TED-LIUM 3 WER2.85WER (%) (lower is better)100
MUN-lang (5-Shot)65.1Win rate (%; share of MUN-lang items where a GPT-4o judge, A100
MUN-vis (5-Shot)63Win rate (%; share of MUN-vis items where a GPT-4o judge, Al100
MUN-vis (Zero-Shot)41Win rate (%; share of MUN-vis items where a GPT-4o judge, Al100
MultivationBench39.22Exact-match accuracy (%, predicted option set equals the gol100

Interactive version: theaggregate.ai/model?slug=phi-4-multimodal-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.