CrowS-Pairs — leaderboard

Crowdsourced Stereotype Pairs benchmark with paired sentences that differ mainly in stereotype direction, measuring social bias in masked language models.

Source: arxiv.org.

Interactive version: theaggregate.ai/benchmark?slug=crows-pairs · How the rankings work · Data refreshed daily, snapshot 2026-07-22.