OpenCompass Knowledge - Science - Chinese (CompassBench 2407): leaderboard

OpenCompass CompassBench 2407 edition (file dated 2024-08-05): science sub-task of the knowledge category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 36 models tracked.

Top models

#ModelScoreOverall rank
1Mistral Large 2 (Jul)77.6#490
2Claude 3.5 Sonnet (20240620)76#308
3GPT-4o (2024-05-13)74.4#337
4Mistral Large74.4#713
5Llama 3.1 70B Instruct73.6#567
6Qwen 2 72B Instruct73.6#579
7Qwen 1.5 110B Chat72#693
8GLM-4 (0520)72#612
9DeepSeek V2 Chat (0628)70.4#409
10GPT-4o Mini (2024-07-18)69.6#568
11Yi Large69.6#566
12Moonshot v1 8K66.4#622
13Gemma 2 27B (IT)64.8#652
14Qwen 2 7B Instruct63.2#982
15GLM-4 9B Chat62.4#911

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-knowledge-science-chinese-compassbench-2407 · How It Works · Data refreshed daily, snapshot 2026-11-05.