ECAC - Caption Quality: leaderboard
Metric: Overall caption quality score (0-100) from a moonshot-v1-8k-vision-preview judge that sees the image and rates the accuracy and professionalism of toy and teaching-aid names, the description of people's expressions and actions, and the identification of the teaching area; zero-shot captioning of ECAC test images; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 2.5 VL 7B Instruct | 85.7 |
| 2 | Gemma 3 27B | 12 |
Interactive version: theaggregate.ai/benchmark?slug=ecac-caption-quality · How It Works · Data refreshed daily, snapshot 2026-10-07.