Phi-3 Mini 128K Instruct: benchmark results

Microsoft's Phi-3-Mini-128K-Instruct, a 3.8B model trained on synthetic and filtered web data, post-trained with SFT and DPO; the 128K-context variant of Phi-3 Mini (4K also available). Provider: Microsoft. Released 2024-04-23. Access: Open.

Aggregate Rating 1379 ± 12, rank #1298 of 1656 rated models, from 149 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU68.7Accuracy (%) (5-shot)91.8
Cyber Bench Hub (v2)98Accuracy (%)90.5
Open LLM Leaderboard v1 - GSM8K69.52Accuracy (%) (5-shot)89.5
MERA - ruHumanEval38.35pass@1 (%)79.9
Open LLM Leaderboard - BBH55.75Score76.4
MERA - ruCodeEval36.28pass@1 (%)76.2
BiGGen-Bench3.68Average Score (1-5)75.5
Enkrypt AI - Jailbreak Risk5.53Risk Score74.3
Open LLM Leaderboard - GPQA31.8Score73.8
Open LLM Leaderboard - IFEval59.76Score71.7
Enkrypt AI - Safety Risk23.89Risk Score63.6
BABILong (NIAH, v0, 8k)50QA1–5 Mean Accuracy (%)62.5

Interactive version: theaggregate.ai/model?slug=phi-3-mini-128k-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.