OpenCompass Math - College - Chinese (CompassBench 2405): leaderboard

OpenCompass CompassBench 2405 edition (file dated 2024-06-12): college mathematics sub-task of the math category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 39 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-05-13)57.9#337
2GPT-4 Turbo52.6#417
3Claude 3 Opus39.5#565
4Yi 1.5 34B Chat39.5#798
5Qwen 1.5 110B Chat39.5#693
6Yi Large39.5#566
7Llama 3 70B Instruct36.8#640
8Mistral Large36.8#713
9Qwen 1.5 32B Chat36.8#820
10DeepSeek V2 Chat36.8#572
11Qwen 1.5 14B Chat34.2#976
12Moonshot v1 8K31.6#622
13Qwen 1.5 72B Chat31.6#782
14Mixtral 8x22B Instruct26.3#738
15Nanbeige2-16B-Chat23.7#971

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-math-college-chinese-compassbench-2405 · How It Works · Data refreshed daily, snapshot 2026-11-05.