NightIQA-Bench - Overall: leaderboard
Nighttime image-quality understanding MCQs across perception, technical assessment, localization and reasoning. MCQ accuracy (%). NightIQA-Bench v1 Table2,1078held-out MCQs from816scene-disjoint images, all0–100accuracy. Zero-shot baseline protocol; local SFT+GRPO8B is a separately trained named system. Native source does not resolve every instruct/thinking checkpoint or closed-model snapshot; those remain source scoped. Sampled random guess is a reference, not an evaluated model.
Metric: MCQ accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 23 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | NightIQA SFT+GRPO 8B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 80.71 | |
| 2 | Qwen 3.5 397B A17B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 80.24 | |
| 3 | Gemini 3.1 Flash Lite (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 78.94 | |
| 4 | Qwen 3.5 35B A3B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 78.48 | |
| 5 | Qwen 3.5 27B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 76.53 | |
| 6 | Qwen 3 VL 235B A22B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 75.51 | |
| 7 | Qwen 3.5 122B A10B (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 74.86 | |
| 8 | GPT-5 Mini (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 74.21 | |
| 9 | GPT-4o (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 73.56 | |
| 10 | MiMo-V2-Omni (Benchmark Sweep Run: source=NightIQA; zero-shot; native Table2 system; checkpoint/effort unreported) | 73.47 |
Interactive version: theaggregate.ai/benchmark?slug=nightiqa-bench-overall · How It Works · Data refreshed daily, snapshot 2026-11-06.