FairLens: leaderboard
Metric: Soundness (%; share of closed-ended answers matching the sound answer, averaged over the hiring, legal and healthcare domains; 1,505 UTKFace portraits (adults 25-65, stratified by gender, race and age) paired with multiple-choice questions; the sound answer follows the evidence stated in the question, or is Cannot tell when the face alone is insufficient; greedy decoding). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 2.5 VL 7B Instruct | 85.7 |
| 2 | GPT-5.2 | 77.1 |
| 3 | Qwen 3 VL 8B | 65.8 |
| 4 | Llama 3.2 11B Vision | 21.9 |
Interactive version: theaggregate.ai/benchmark?slug=fairlens · How It Works · Data refreshed daily, snapshot 2026-09-26.