OpenCompass Knowledge - Social Science - Chinese (CompassBench 2504): leaderboard

OpenCompass CompassBench 2504 edition (file dated 2025-05-13): social science sub-task of the knowledge category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 28 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4.1 (2025-04-14)92#257
2GPT-4.1 Mini91#363
3Grok 391#313
4Llama 4 Maverick Instruct91#467
5Gemini 2.5 Pro (Preview 05-06)91#156
6O4 Mini (High)89#185 (O4 Mini)
7Step 2 16K89#442
8DeepSeek V3 (0324)88#349
9O3 Mini (High)87#282 (O3 Mini)
10DeepSeek R186#262
11ERNIE-X1-Turbo-32K86#288
12Claude 3.7 Sonnet (Thinking)85#259 (Claude 3.7 Sonnet)
13Gemma 3 27B (IT)84#528
14Qwen 3 235B A22B (Thinking)84#323 (Qwen 3 235B A22B)
15Llama 4 Scout Instruct83#547

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-knowledge-social-science-chinese-compassbench-2504 · How It Works · Data refreshed daily, snapshot 2026-11-05.