DistortBench - Luminance: leaderboard

Metric: Joint accuracy (%) on the four luminance distortions (brighten, darken, mean shift, contrast), a category of DistortBench's 13,500 four-choice questions (27 distortion types at five KADID-10k calibrated severity levels on 100 KADIS-700k photos, no reference image), the answer naming both type and severity, answered-only accuracy (unparseable responses, at most 3.4 percent, leave the denominator), chance 25; higher is better. Source: arxiv.org. Saturation forecast: Around October 2027. 18 models tracked.

Top models

#ModelScore
1Qwen 3.5 27B (Non-reasoning)59.2
2Qwen 3.5 27B52.3
3Qwen 3.5 35B A3B (Non-reasoning)51.5
4GPT-5.451.4
5Qwen 3.5 4B (Non-reasoning)45.7
6Qwen 3.5 9B (Non-reasoning)43.8
7Qwen 3.5 4B43.6
8Qwen 3.5 9B43
9Qwen 3.5 35B A3B41.6
10Gemma 3 27B40.5
11Gemma 3 12B38
12Qwen 2 VL 7B34.7
13Gemma 3 4B19.4

Interactive version: theaggregate.ai/benchmark?slug=distortbench-luminance · How It Works · Data refreshed daily, snapshot 2026-10-07.