ColorBench: leaderboard
Multiple-choice questions (3 to 6 options) about colour in images: recognising, extracting, comparing and counting colours, colour illusions, camouflage and colour-blindness plates; 955 questions per model, accuracy in percent. Unlike general image QA boards, every item turns on colour.
Metric: P&R Overall accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 31 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.0 Flash | 55.4 | #723 |
| 2 | llava-onevision-qwen2-72B-ov-sft | 51.9 | #1957 |
| 3 | InternVL2.5-38B | 50 | #1366 |
| 4 | InternVL2.5-78B | 48.8 | #1036 |
| 5 | InternVL2.5-26B | 46.8 | #2191 |
| 6 | LLaVA-v1.6-34B | 46.6 | #5432 |
| 7 | InternVL2-26B | 46.3 | #2639 |
| 8 | Qwen 2.5 VL 7B Instruct | 46.2 | #1893 |
| 9 | InternVL2-40B | 45.6 | #2094 |
| 10 | Cambrian-34B | 45.3 | #5007 |
| 11 | InternVL2.5-8B | 45.2 | #2401 |
| 12 | LLaVA-NeXT-72B | 45.2 | #3206 |
| 13 | llava-onevision-qwen2-7B-ov | 44.7 | #3252 |
| 14 | InternVL2-Llama3-76B | 44.6 | #2021 |
| 15 | eagle-x4-8B-plus | 44.1 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=colorbench · How It Works · Data refreshed daily, snapshot 2026-11-17.