OpenCompass LLM - Language - Chinese (CompassBench 2407): leaderboard

Metric: Score (%). Source: rank.opencompass.org.cn. 36 models tracked.

Top models

#ModelScore
1GPT-4o (2024-05-13)59.6
2Qwen 1.5 110B Chat56.8
3Qwen 2 72B Instruct52.6
4Qwen 2 7B Instruct52.1
5Claude 3.5 Sonnet (20240620)51.2
6Yi 1.5 34B Chat51
7Mistral Large50.7
8Mistral Large 2 (Jul)50.3
9GPT-4o Mini (2024-07-18)50
10Yi Large48.3
11Yi-1.5-9B Chat48.2
12Yi-1.5-6B-Chat48.2
13DeepSeek V2 Chat (0628)47.7
14Moonshot v1 8K47.1
15Gemma 2 27B (IT)46.5

Interactive version: theaggregate.ai/benchmark?slug=opencompass-llm-language-chinese-compassbench-2407 · How It Works · Data refreshed daily, snapshot 2026-09-19.