OpenCompass Agent - T-Eval - Chinese (CompassBench 2405): leaderboard

OpenCompass CompassBench 2405 edition (file dated 2024-06-12): general tool utilization (T-Eval) sub-task of the agent category, Chinese questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 39 models tracked.

Top models

#ModelScoreOverall rank
1Nanbeige2-16B-Chat90.4#971
2Mixtral 8x22B Instruct85.4#738
3GPT-4 Turbo84.9#417
4Mistral Large84.9#713
5Yi Large84.6#566
6Claude 3 Opus83.9#565
7Command-R+83.1#869
8GPT-4o (2024-05-13)81.9#337
9Yi 1.5 34B Chat79.4#798
10Qwen 1.5 32B Chat75.9#820
11DeepSeek V2 Chat75.6#572
12Mistral 7B Instruct (v0.3)74.3#1255
13GLM-474.2#647
14GPT-3.5 Turbo72.5#858
15DeepSeek-V2-Lite-Chat71.2#1189

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-agent-t-eval-chinese-compassbench-2405 · How It Works · Data refreshed daily, snapshot 2026-11-05.