Phi-3-medium-128k-instruct: benchmark results
Microsoft's 14B Phi-3 Medium instruct model with a 128K context, trained on synthetic and filtered web data. Provider: Microsoft. Released 2024-05-21. Access: Open.
Unified ELO 1473 ± 1, rank #823 of 1392 rated models, from 60 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| ARC Challenge (AI2) | 91.6 | Accuracy (%) | 94.7 |
| Big-Bench Hard | 81.4 | Average (%) | 93.8 |
| OpenBookQA | 87.4 | Accuracy (%) | 92.9 |
| Open LLM Leaderboard - BBH | 48.46 | Score | 88.7 |
| BBH | 81.4 | Score (self-reported) | 86.7 |
| Open LLM Leaderboard - MMLU-Pro | 41.24 | Score | 86 |
| CanAiCode | 100 | Junior-v2 Python Pass Rate (%) | 85.6 |
| Open LLM Leaderboard - GPQA | 11.52 | Score | 83 |
| Open Korean LLM Leaderboard | 41.58 | Average Score (%) | 80.1 |
| WinoGrande | 81.5 | Accuracy (%) | 79.4 |
| MERA - BPS | 98.9 | Accuracy (%) | 79.1 |
| MMLU | 78 | Accuracy (%) | 76.3 |
Interactive version: theaggregate.ai/model?slug=phi-3-medium-128k-instruct · How It Works · Data refreshed daily, snapshot 2026-09-05.