StylisticBias - Age Disparity: leaderboard

StylisticBias (Kolli et al., 2026) asks multimodal LLMs 25 forced-choice social judgments (competent or incompetent, trustworthy or untrustworthy, wealthy or poor and others) about 500 generated studio portraits, in four option orders with three seeds each. Variation strength measures how much the rate of favourable choices differs across young adult, middle-aged and elderly faces, from 0 to 0.5 averaged over scenarios; lower is better.

Metric: Variation strength (0-0.5; between-group dispersion of the favourable-choice rate across young adult, middle-aged and elderly faces, averaged over 25 binary social-judgment scenarios on the unmodified base portraits; lower means judgments depend less on age). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScoreOverall rank
1InternVL3-14B0.04#1184
2Qwen 3 VL 8B Instruct0.04#982
3gemma-4-E4B-it0.07#1462
4Gemma 3 12B (IT)0.09#1849
5Pixtral-12B0.11#2493

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=stylisticbias-age-disparity · How It Works · Data refreshed daily, snapshot 2026-11-12.