VMetaphor-Bench - Meaning: leaderboard
Meaning in VMetaphor-Bench (Chen et al., 2026): one multiple-choice question per generated image on whether it conveys the intended metaphorical message, answered by a Qwen3.5-27B judge. Accuracy in percent; higher is better. Conceptual prompts, which state only the metaphorical idea.
Metric: MCQ accuracy (%; one question per image on the overall metaphorical message; the generated image is judged by Qwen3.5-27B on multiple-choice questions (four options including cannot be determined) built from each metaphor's structured annotation; 1,500 visual metaphors curated from real creative imagery; conceptual prompts that state only the metaphorical idea). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Nano Banana 2 (Gemini 3.1 Flash Image Preview) | 98.5 | |
| 2 | GPT Image 1.5 | 97.6 | |
| 3 | Seedream 5.0 Lite | 96 | |
| 4 | FLUX.2-dev | 92.1 | |
| 5 | Qwen-Image-2512 | 90.5 | |
| 6 | Z-Image-Turbo | 89.5 | |
| 7 | Janus-Pro-7B | 89.1 | #7341 |
| 8 | Stable Diffusion 3.5 Large | 85.7 | |
| 9 | FLUX.1-dev | 85.6 | |
| 10 | BAGEL-7B-MoT | 84.2 | #5515 |
Interactive version: theaggregate.ai/benchmark?slug=vmetaphor-bench-meaning · How It Works · Data refreshed daily, snapshot 2026-11-12.