MinCU - Counting: leaderboard
The counting-change split of MinCU (Mu et al., 2026): 500 image pairs in which the number of instances of an object changes. Grounded F1 in percent, crediting a prediction only when its box, change description and entity label are all correct; higher is better.
Metric: Grounded F1 (%; counting changes (the number of instances altered), 500 image pairs; a true positive needs the predicted box to reach IoU 0.5 with the changed region, the change description BERTScore 0.85 against the reference and the correct changed-entity label; zero-shot). Source: arxiv.org. Saturation forecast: Around November 2028. 15 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Seed 1.8 | 42.81 | #239 |
| 2 | Gemini 3.1 Pro (Preview) | 26.28 | #91 |
| 3 | GPT-5.4 | 22.17 | #121 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mincu-counting · How It Works · Data refreshed daily, snapshot 2026-11-12.