CIBuzzBench - Equivalent Selection (Chinese Prompt): leaderboard
Metric: Macro F1 (%; four-way choice of the English equivalent against literal, cultural-mismatch and pragmatic-neighbor distractors, mean over five option-shuffle seeds; Chinese instructions; 3,001 Chinese internet buzzwords; zero-shot, temperature 0; the Chinese buzzword is the input under both prompt languages). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 88.41 |
| 2 | GPT-5.5 | 87.83 |
| 3 | Qwen 3.7 Max | 84.8 |
| 4 | GLM-5.2 | 84.4 |
| 5 | Claude Opus 4.8 | 83.17 |
| 6 | DeepSeek V4 Pro | 78.91 |
| 7 | Qwen 3 14B | 56.98 |
| 8 | Qwen 3 8B | 54.91 |
| 9 | Qwen 3 4B | 45.41 |
Interactive version: theaggregate.ai/benchmark?slug=cibuzzbench-equivalent-selection-chinese-prompt · How It Works · Data refreshed daily, snapshot 2026-09-26.