O3 Mini (2025-01-31): benchmark results
January 31, 2025 O3 Mini snapshot, tracked when sources report the dated API model. Provider: OpenAI. Released 2025-01-31. Access: API.
Unified ELO 1590 ± 1, rank #291 of 1392 rated models, from 222 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| BIRD-CRITIC | 34.5 | Score | 100 |
| BigCodeBench-Hard | 33.1 | Instruct pass@1 (self-reported) | 100 |
| HELM MedHELM - CLEAR | 83.06 | EM | 100 |
| HELM MedHELM - Medec | 68.68 | MedecFlagAcc | 100 |
| HELM MedHELM - Medical Research | 76.39 | Mean win rate | 100 |
| HELM MedHELM - SHC-GIP | 78.4 | EM | 100 |
| EuroEval Danish NLU - Angry Tweets | 62.16 | Sentiment classification Score (%) | 98.6 |
| Galileo Tool Tasks - xLAM Single Tool Single Call | 100 | Accuracy (%) | 97.2 |
| HELM MedHELM - n2c2 CT Matching | 89.53 | EM | 95.8 |
| Galileo Tool Tasks - BFCL v3 Multi-Turn Missing Parameter | 93 | Accuracy (%) | 94.4 |
| EuroEval English NLU - CoNLL EN | 84.79 | Named entity recognition Score (%) | 92.5 |
| EuroEval English Knowledge | 93.33 | Knowledge Average Score (%) | 92.1 |
Interactive version: theaggregate.ai/model?slug=o3-mini-2025-01-31 · How It Works · Data refreshed daily, snapshot 2026-09-05.