Harm or Humor (English Text) - Macro-F1: leaderboard

Metric: Macro-F1 (%) over the safe and harmful classes on the 2,000 English text jokes; each joke is labelled safe or harmful (harmful jokes being explicit or implicit) and the model classifies it as safe or harmful zero-shot; blocked or empty responses count as harmful; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.290.2#105
2GPT-4o86.1#333
3Gemini 2.5 Pro84.5#145
4AceGPT-v2-32B-Chat83#495
5Gemini 3 Pro79.4#77
6ALLaM-7B-Instruct-preview73#698

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=harm-or-humor-english-text-macro-f1 · How It Works · Data refreshed daily, snapshot 2026-10-11.