GPT-2 Medium: benchmark results

OpenAI's GPT-2 Medium, the 355M-parameter version of GPT-2, a transformer-based English causal language model, part of the GPT-2/GPT-2-Large/GPT-2-XL family. Provider: OpenAI. Released 2019-05-03. Access: Open.

Aggregate Rating 1146 ± 43, rank #1630 of 1656 rated models, from 110 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
StereoSet71.73ICAT Score80
AI Energy Score (Text Generation)5Energy Score (1-5)79.5
EuroEval Icelandic Common Sense Reasoning3.57Common Sense Reasoning Average Score (%)38.4
Open LLM Leaderboard - MuSR38.84Score34.3
EuroEval Norwegian Knowledge - Idioms NO0.39MCC (x100)26.9
EuroEval Spanish NLU - ScaLA ES0.73Matthews correlation coefficient (%)26.3
EuroEval Norwegian NLU - ScaLA NN1.06Matthews correlation coefficient (%)18.7
Open Portuguese LLM - OAB Exams26.2Accuracy (%)18.5
Open Portuguese LLM - FaQuAD NLI43.97Macro F1 (%)17.1
Open LLM Leaderboard - GPQA26.26Score16.5
EuroEval Portuguese NLU - ScaLA PT0.62Matthews correlation coefficient (%)16.4
Open LLM Leaderboard - IFEval22.08Score15.1

Interactive version: theaggregate.ai/model?slug=gpt-2-medium · How It Works · Data refreshed daily, snapshot 2026-10-20.