FairLens - Legal: leaderboard
Metric: Soundness (%; legal-domain closed-ended questions, 9 items per image; 1,505 UTKFace portraits (adults 25-65, stratified by gender, race and age) paired with multiple-choice questions; the sound answer follows the evidence stated in the question, or is Cannot tell when the face alone is insufficient; greedy decoding). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.2 | 86.4 |
| 2 | Qwen 2.5 VL 7B Instruct | 82.8 |
| 3 | Qwen 3 VL 8B | 45.7 |
| 4 | Llama 3.2 11B Vision | 7 |
Interactive version: theaggregate.ai/benchmark?slug=fairlens-legal · How It Works · Data refreshed daily, snapshot 2026-09-26.