GPT-4o Audio: benchmark results

Provider: OpenAI. Released 2024-10-17. Access: API.

Aggregate Rating 1590 ± 18, rank #1121 of 10916 rated models, from 168 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
APUN-Bench (Real-World) - Homographic Pun Inference50.7Homographic pun-inference accuracy (%), both predicted meani100
APUN-Bench (Synthetic) - Coarse Pun Location75.97Coarse pun-location accuracy (%), the predicted pun word mat100
APUN-Bench (Synthetic) - Fine Pun Location56.63Fine pun-location accuracy (%), the predicted pun word exact100
APUN-Bench (Synthetic) - Heterographic Pun Inference59.06Heterographic pun-inference accuracy (%), the predicted alte100
APUN-Bench (Synthetic) - Homographic Pun Inference57.81Homographic pun-inference accuracy (%), both predicted meani100
Ambiguous Speech Emotion - CREMA-D0.29Jensen-Shannon divergence (0-1; between the emotion distribu100
AudioBench - SLUE P2 SQA589.41Mean Score (%)100
CASU - Contextual Reasoning74.02Accuracy (%; four-option multiple-choice questions on semi-s100
CASU - Counterfactual Reasoning74.96Accuracy (%; four-option multiple-choice questions on semi-s100
HumDial-EIBench - Text Empathy (Chinese, Gemini 2.5 Pro Judge)3.79Text empathy and insight score (1-5) of the model's empathet100
HumDial-EIBench - Text Empathy (Chinese, Qwen3-Omni Judge)3.77Text empathy and insight score (1-5) of the model's empathet100
HumDial-EIBench - Text Empathy (English, Gemini 2.5 Pro Judge)4.1Text empathy and insight score (1-5) of the model's empathet100

Interactive version: theaggregate.ai/model?slug=gpt-4o-audio · How It Works · Data refreshed daily, snapshot 2026-11-08.