VDE Bench (Local) - IoU: leaderboard
Metric: Mean IoU of OCR text blocks matched by centre distance to the gold blocks (0-1, shown times 100; unmatched gold and predicted blocks count as misses), within the single annotated edit region (the output cropped to the gold edit box); VDE Bench's 942 human-verified instruction-based edits of dense Chinese and English document pages (papers, slides, posters, exams, newspapers; text replacement, insertion and deletion and table edits; gold edited pages verified by 15 annotators); the edited page is read with PaddleOCR-VL and compared with the gold page, default generation settings; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | LongCat-Image-Edit | 66.2 | |
| 2 | FireRed-Image-Edit-1.0 | 63.9 | |
| 3 | Step1X-Edit (VDE Bench checkpoint unspecified) | 63.3 | |
| 4 | Qwen-Image-Edit (VDE Bench checkpoint unspecified) | 59.5 | |
| 5 | InstructPix2Pix | 43.5 | |
| 6 | ICEdit | 5.3 |
Interactive version: theaggregate.ai/benchmark?slug=vde-bench-local-iou · How It Works · Data refreshed daily, snapshot 2026-10-11.