AHA-Memes - Fine-Grained Hate Types: leaderboard

Metric: Fine-grained macro-F1 (%) over ten hate and non-hate type labels (multi-label), zero-shot on the 5K human-annotated gold test split of Arabic memes (image with its OCR text); higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 9 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro34
2GPT-530.1
3Gemini 3.5 Flash27.1
4Qwen 3 VL 8B (Thinking)19.1
5Qwen 3 VL 8B Instruct17.6
6InternVL3.5-8B16.4

Interactive version: theaggregate.ai/benchmark?slug=aha-memes-fine-grained-hate-types · How It Works · Data refreshed daily, snapshot 2026-09-29.