OpenCompass Knowledge - Social Science - Chinese (CompassBench 2407): leaderboard

OpenCompass CompassBench 2407 edition (file dated 2024-08-05): social science sub-task of the knowledge category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 36 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-05-13)85.6#337
2Claude 3.5 Sonnet (20240620)84#308
3Qwen 2 72B Instruct82.4#579
4DeepSeek V2 Chat (0628)80.8#409
5GLM-4 (0520)80#612
6GPT-4o Mini (2024-07-18)79.2#568
7Mistral Large 2 (Jul)79.2#490
8Mistral Large79.2#713
9Llama 3.1 70B Instruct78.4#567
10Qwen 1.5 110B Chat77.6#693
11Moonshot v1 8K76#622
12Yi Large76#566
13GLM-4 9B Chat69.6#911
14InternLM2.5-Chat-7B68#1009
15Qwen 2 7B Instruct67.2#982

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-knowledge-social-science-chinese-compassbench-2407 · How It Works · Data refreshed daily, snapshot 2026-11-05.