OpenCompass Language - Creation - Chinese (CompassBench 2411): leaderboard

OpenCompass CompassBench 2411 edition (file dated 2024-12-02): creative writing sub-task of the language category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 34 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-11-20)66.1#392
2O1 Mini (2024-09-12)64.1#412
3Yi Lightning62.9#429
4DeepSeek V2.560.3#494
5TeleChat259.2#599
6GLM-4 Plus57#398
7Claude 3.5 Sonnet (20241022)56.4#302
8Grok Beta55.5#497
9Qwen 2.5 72B Instruct54.6#469
10360gpt2-pro53.8#557
11Mistral Large 2 (Nov) Instruct (2411)50.2#480
12GPT-4o (2024-08-06)50#343
13Step 2 16K50#442
14Yi 1.5 34B Chat49#798
15Yi-1.5-9B Chat46.7#1032

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-language-creation-chinese-compassbench-2411 · How It Works · Data refreshed daily, snapshot 2026-11-05.