CIBuzzBench - Meaning Explanation (Chinese Prompt): leaderboard

Metric: Human rating (out of 5) (semantic and pragmatic equivalence of the English explanation of the buzzword to the gold annotated sense, scored 0-5 by human annotators on 200 randomly sampled predictions per model; Chinese instructions; 3,001 Chinese internet buzzwords; zero-shot, temperature 0; the Chinese buzzword is the input under both prompt languages). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)3.9
2Qwen 3.7 Max3.84
3GLM-5.23.61
4GPT-5.53.13
5DeepSeek V4 Pro3.06
6Claude Opus 4.83.03
7Qwen 3 14B2.08
8Qwen 3 8B1.79
9Qwen 3 4B1.35

Interactive version: theaggregate.ai/benchmark?slug=cibuzzbench-meaning-explanation-chinese-prompt · How It Works · Data refreshed daily, snapshot 2026-09-26.