MaMe-Re (Speech Text): leaderboard

Metric: Score@1 (%; mean share of five crowdworkers who rated the chosen manga-panel reply funny, 250 contexts, panels given by their speech text). Source: arxiv.org. Saturation forecast: Around 2030. 6 models tracked.

Top models

#ModelScore
1GPT-5 Mini32.2
2GPT-531.4
3Gemini 2.5 Flash29.6
4GPT-OSS-120B29.2
5Gemini 2.5 Pro28.6
6Claude Sonnet 4 (20250514)28

Interactive version: theaggregate.ai/benchmark?slug=mame-re-speech-text · How It Works · Data refreshed daily, snapshot 2026-09-25.