OpenCompass Subjective - Reasoning (CompassBench 2404): leaderboard

OpenCompass CompassBench 2404 edition (file dated 2024-05-09): subjective open-ended evaluation, reasoning score. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 51 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-05-13)56.5#337
2GPT-4 Turbo55.5#417
3GPT-4 Turbo (Preview)50#416
4Claude 3 Opus49.8#565
5GLM-449.5#647
6Moonshot v1 8K47.8#622
7Qwen 1.5 110B Chat47.5#693
8DeepSeek V2 Chat41.2#572
9Qwen 1.5 72B Chat41#782
10Yi Chat 34B38#950
11Qwen-72B-Chat37#835
12Qwen 1.5 14B Chat34.2#976
13Llama 3 70B Instruct34#640
14GPT-3.5 Turbo31#858
15Qwen-14B-Chat31#1161

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-subjective-reasoning-compassbench-2404 · How It Works · Data refreshed daily, snapshot 2026-11-05.