TinyGrafixBench - Heatmap: leaderboard
TinyGrafixBench mIoU (%) on heatmap edits (adding a cell, shifting the map, masking cells and changing the colormap), scored pixel by pixel against the single correct image; higher is better (PaintBench paper, NYU, 2026).
Metric: mIoU (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Nano-Banana-2 | 20.2 | |
| 2 | GPT-Image-2 | 15.5 | |
| 3 | LongCat-Image-Edit | 7.9 | |
| 4 | Qwen-Image-Edit-2511 | 4.9 | |
| 5 | FLUX.2-klein-9B | 4.8 | |
| 6 | Nano Banana | 4 | |
| 7 | FLUX.1-Kontext-dev | 3.5 | |
| 8 | FLUX.2-dev | 3.2 | |
| 9 | BAGEL-7B-MoT | 2 | #5515 |
| 10 | HunyuanImage-3.0 | 0.9 |
Interactive version: theaggregate.ai/benchmark?slug=tinygrafixbench-heatmap · How It Works · Data refreshed daily, snapshot 2026-11-12.