OpenCompass Language - NLP - Chinese (CompassBench 2407): leaderboard

Metric: Score (%). Source: rank.opencompass.org.cn. 36 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20240620)63.7
2Qwen 2 72B Instruct63
3Qwen 2 7B Instruct59.4
4Qwen 1.5 110B Chat57.9
5GPT-4o (2024-05-13)55.5
6Gemma 2 27B (IT)53.9
7Moonshot v1 8K52.4
8DeepSeek V2 Chat (0628)52.4
9Gemma 2 9B (IT)51.9
10Yi Large51.2
11GPT-4o Mini (2024-07-18)49.5
12Yi 1.5 34B Chat48.3
13Mistral Large48.1
14Mistral Large 2 (Jul)47.1
15GLM-4 (0520)47.1

Interactive version: theaggregate.ai/benchmark?slug=opencompass-language-nlp-chinese-compassbench-2407 · How It Works · Data refreshed daily, snapshot 2026-09-19.