GPT-3.5 Turbo (0125): benchmark results

OpenAI's GPT-3.5 Turbo checkpoint gpt-3.5-turbo-0125, released in the API on February 1, 2024. Provider: OpenAI. Released 2024-02-01. Access: API.

Aggregate Rating 1452 ± 8, rank #984 of 1656 rated models, from 650 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SpeechMap Compliance94.5% Requests Completed97.1
CanItEdit (Lazy)42.71pass@1 (%; share of the 105 hand-written Python editing prob95.8
ConflictQA - KG Conflict (Non-Complementary)36.41Exact match (%) on 802 single-hop (non-complementary) questi90.9
LogicKor - Grammar8Score (0-10)90.5
LogicKor - Understanding9.57Score (0-10)88
Open Portuguese LLM - OAB Exams54.31Accuracy (%)85.8
HELM AIR-Bench 2024 - #6.24: Accounting63.33Refusal Rate (%)84.9
CanItEdit (Descriptive)48.14pass@1 (%; share of the 105 hand-written Python editing prob83.3
Open Portuguese LLM - BLUEX62.45Accuracy (%)82.4
Open Portuguese LLM - ENEM72.15Accuracy (%)82.3
LogicKor - Multi-Turn7.88Score (0-10)80.9
HELM AIR-Bench 2024 - #39-40.47: Classification of individuals - Beliefs58.33Refusal Rate (%)79.1

Interactive version: theaggregate.ai/model?slug=gpt-3-5-turbo-0125 · How It Works · Data refreshed daily, snapshot 2026-10-20.