GPT-4o (Mar 2025): benchmark results

March 2025 GPT-4o snapshot kept separate from other GPT-4o rows because benchmark sources report distinct scores. Provider: OpenAI. Released 2025-03-01. Access: API.

Aggregate Rating 1641 ± 24, rank #330 of 1656 rated models, from 31 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LLM Emergent Collusion23Collusion Rate (%)91.7
Elimination Game (Lechmazur)5.5TrueSkill μ89.8
OpenAI MentalHealthBench - Behavior - User Agency59.51Axis score, normalized to its possible range (%)71.4
AA MMLU-Pro80.29Accuracy (%)68.1
OpenAI MentalHealthBench - Behavior - Communication66.84Axis score, normalized to its possible range (%)64.3
BAZAAR (Lechmazur)5.89TrueSkill μ56
AA LiveCodeBench42.54Pass@1 (%)50.4
Generalization V1 (Lechmazur)1.97Avg Rank (lower is better)43.1
OpenAI MentalHealthBench - Behavior - Interpretation56.93Axis score, normalized to its possible range (%)42.9
NYT Connections Older Models11.8Score (%)42
AA GPQA Diamond65.45Accuracy (%)40.5
Step Game (Lechmazur)1.55TrueSkill μ39.2

Interactive version: theaggregate.ai/model?slug=gpt-4o-mar-2025 · How It Works · Data refreshed daily, snapshot 2026-10-20.