E-comIQ-18k - Object: leaderboard

Metric: Acc@0.5 (%): share of the 1,000 E-comIQ-18k test posters (AI-generated Chinese e-commerce posters) whose predicted object score falls within 0.5 of the expert-calibrated reference score on the 1-5 quality scale; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 11 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.549.4#138
2GPT-4o47.8#333
3Grok 442.9#169
4Qwen 2.5 VL 72B Instruct42.6#364
5Gemini 2.5 Pro42.2#145
6Qwen 2.5 VL 7B Instruct40.2#643

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=e-comiq-18k-object · How It Works · Data refreshed daily, snapshot 2026-10-11.