StereoSet: leaderboard

Stereotype bias benchmark for language models, testing model preference among stereotypical, anti-stereotypical, and unrelated continuations across social domains.

Metric: ICAT Score. Source: github.com. Source: huggingface.co. 11 models tracked.

Top models

#ModelScoreOverall rank
1GPT-272.97#1647
2GPT-2 Medium71.73#1630
3GPT-2 Large70.54#1642
4text-davinci-00260.8#1225
5OPT-175B60#1538

Interactive version: theaggregate.ai/benchmark?slug=stereoset · How It Works · Data refreshed daily, snapshot 2026-10-20.