OpenCompass LLM - Agent (CompassBench 2407): leaderboard

Metric: Score (%). Source: rank.opencompass.org.cn. 36 models tracked.

Top models

#ModelScore
1Llama 3.1 70B Instruct86.5
2Yi Large86.1
3Mixtral 8x22B Instruct (v0.1)86
4Qwen 2 72B Instruct85.9
5GPT-4o Mini (2024-07-18)85.7
6Gemma 2 27B (IT)85.5
7Mistral Large 2 (Jul)84.5
8GPT-4o (2024-05-13)84.4
9DeepSeek V2 Chat (0628)83.7
10Mistral Large83.5
11GLM-4 9B Chat81.9
12Claude 3.5 Sonnet (20240620)81.7
13GLM-4 (0520)80.4
14internlm2-chat-20B80.3
15Llama 3.1 8B Instruct80.1

Interactive version: theaggregate.ai/benchmark?slug=opencompass-llm-agent-compassbench-2407 · How It Works · Data refreshed daily, snapshot 2026-09-19.