RebusBench (1-Shot): leaderboard

Metric: Exact match: exact match accuracy (%) against the gold answer after lowercasing and stripping whitespace and special characters, on the 1,164 human-authored rebus puzzles of RebusBench, one in-context example in the text prompt; higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 9 models tracked.

Top models

#ModelScore
1Qwen 2.5 VL 32B Instruct7.39
2Qwen 2.5 VL 7B Instruct5.15

Interactive version: theaggregate.ai/benchmark?slug=rebusbench-1-shot · How It Works · Data refreshed daily, snapshot 2026-10-07.