HOI-Edit - Spatial Understanding: leaderboard

Metric: Interaction score gated by a context question (0-100), zero when the spatial check fails, on the 202 Level-2 edits (pick the right target among similar ones, place it at the right destination), scored by HOI-Eval: the human and object boxes are tracked into the edited image and Gemini 2.5 Pro rates the interaction from tagged crops; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScore
1Nano Banana59.6
2Wan2.2-I2V-A14B55.26
3Qwen-Image-Edit PLUS49.28
4Bagel47.81
5ChronoEdit46.08
6Step1X-Edit40.58
7FLUX.1 Kontext [dev]27.8
8ByteMorph22.4

Interactive version: theaggregate.ai/benchmark?slug=hoi-edit-spatial-understanding · How It Works · Data refreshed daily, snapshot 2026-09-29.