FairLens - Healthcare: leaderboard
Metric: Soundness (%; healthcare-domain closed-ended questions, 8 items per image; 1,505 UTKFace portraits (adults 25-65, stratified by gender, race and age) paired with multiple-choice questions; the sound answer follows the evidence stated in the question, or is Cannot tell when the face alone is insufficient; greedy decoding). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.2 | 77.7 |
| 2 | Qwen 2.5 VL 7B Instruct | 77.5 |
| 3 | Qwen 3 VL 8B | 56.8 |
| 4 | Llama 3.2 11B Vision | 4.4 |
Interactive version: theaggregate.ai/benchmark?slug=fairlens-healthcare · How It Works · Data refreshed daily, snapshot 2026-09-26.