ChatGPT 4o: benchmark results

Provider: OpenAI. Released 2024-08-15. Access: API.

Aggregate Rating 1660 ± 31, rank #296 of 1635 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AgentDrive82.5Accuracy (%)100
AgentDrive - Hybrid72.5Accuracy (%)100
EIBench (complex)39.27Recall100
VERHallu - Counterfactual QA68.5Accuracy (%; 967 seven-option questions about an event absen100
VERHallu - Subevent QA42.5Accuracy (%; 258 seven-option questions on which event occur100
AgentDrive - Policy100Accuracy (%)99
VERHallu - Causal QA46.5Accuracy (%; 497 seven-option questions on why an event happ94.1
AgentDrive - Physics55Accuracy (%)90
AgentDrive - Comparative90Accuracy (%)75
OmniCoT31.58Overall accuracy (%), question-weighted over the See, Locate75
OmniCoT - Move33.65Accuracy (%) on Move questions (translational and rotation-t75
Roboflow Vision Evals - Visual Understanding70.15Pass Rate (%)73

Interactive version: theaggregate.ai/model?slug=chatgpt-4o · How It Works · Data refreshed daily, snapshot 2026-11-05.