M3R-Bench - Metaphor Detection: leaderboard

M3R-Bench (Jiang et al., 2026) contains 1,000 human-annotated image-text pairs from social media and advertisements for multimodal metaphor understanding, where each model jointly predicts metaphor presence, target and source concepts and sentiment. This board scores metaphor detection by macro-F1 in percent; higher is better.

Metric: Macro-F1 (%; whether an image-text pair contains a multimodal metaphor, 1,000 instances, 510 metaphorical, predicted jointly with target, source and sentiment). Source: arxiv.org. Saturation forecast: Around 2030. 8 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 32B Instruct61.82#582
2Kimi K2.555.12#252
3GPT-5.554.56#48
4Qwen 3 VL 8B Instruct52.26#982
5GPT-4o50.19#741
6Claude Sonnet 4.639.03#158

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=m3r-bench-metaphor-detection · How It Works · Data refreshed daily, snapshot 2026-11-12.