OpenCompass LLM - Agent - Chinese (CompassBench 2405): leaderboard

OpenCompass CompassBench 2405 edition (file dated 2024-06-12): agent (tool use) category score, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 39 models tracked.

Top models

#ModelScoreOverall rank
1Claude 3 Opus80.7#565
2Mistral Large80.1#713
3Nanbeige2-16B-Chat76.4#971
4Yi Large75.4#566
5Command-R+72.7#869
6GPT-4 Turbo72.5#417
7GPT-4o (2024-05-13)71#337
8Yi 1.5 34B Chat70.7#798
9Qwen 1.5 32B Chat70.7#820
10GLM-470.2#647
11GPT-3.5 Turbo69.7#858
12Mixtral 8x22B Instruct68.6#738
13DeepSeek V2 Chat66.2#572
14Llama 3 70B Instruct63.6#640
15DBRX63.2#1041

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-llm-agent-chinese-compassbench-2405 · How It Works · Data refreshed daily, snapshot 2026-11-05.