CIBuzzBench - Meaning Explanation (Chinese Prompt): leaderboard

CIBuzzBench (Wang et al., 2026) tests cross-lingual understanding of Chinese internet buzzwords. In Meaning Explanation the model explains the non-literal sense of a buzzword in English under Chinese-language instructions, with the Chinese buzzword as input; human annotators rate 200 sampled explanations per model from 0 to 5 for semantic and pragmatic equivalence to the gold sense, higher is better.

Metric: Human rating (out of 5) (semantic and pragmatic equivalence of the English explanation of the buzzword to the gold annotated sense, scored 0-5 by human annotators on 200 randomly sampled predictions per model; Chinese instructions; 3,001 Chinese internet buzzwords; zero-shot, temperature 0; the Chinese buzzword is the input under both prompt languages). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)3.9#91
2Qwen 3.7 Max3.84#142
3GLM-5.23.61#137
4GPT-5.53.13#48
5DeepSeek V4 Pro3.06#181
6Claude Opus 4.83.03#56
7Qwen 3 14B2.08#1235
8Qwen 3 8B1.79#1838
9Qwen 3 4B1.35#2297

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cibuzzbench-meaning-explanation-chinese-prompt · How It Works · Data refreshed daily, snapshot 2026-11-12.