O1 Mini: benchmark results

OpenAI's smaller o1-series reasoning model for cost-efficient STEM tasks. Provider: OpenAI. Released 2024-09-12. Access: API.

Aggregate Rating 1643 ± 7, rank #323 of 1656 rated models, from 205 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AgentIF59.8Constraint Success Rate (imported)100
Carlini Applied LLM Benchmark62Pass Rate (%)100
EnterpriseBench Sandbox (DSPy, CoT)0.33Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (DSPy, Gold Plan)0.62Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (DSPy, No Planning)0.29Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (DSPy, ReAct)0.38Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (LangChain, CoT)0.28Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (LangChain, Gold Plan)0.51Judged task accuracy (0-1; 500 enterprise tasks, final execu100
EnterpriseBench Sandbox (LangChain, ReAct)0.35Judged task accuracy (0-1; 500 enterprise tasks, final execu100
Omni-MATH60.54Overall Accuracy (%)100
ProLLM - Q&A Assistant98.9Score (%)100
SEAL - Coding1237Score100

Interactive version: theaggregate.ai/model?slug=o1-mini · How It Works · Data refreshed daily, snapshot 2026-10-20.