OpenCompass Subjective - Language (CompassBench 2404): leaderboard

OpenCompass CompassBench 2404 edition (file dated 2024-05-09): subjective open-ended evaluation, language score. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 51 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-05-13)57.8#337
2Claude 3 Opus56.2#565
3Qwen 1.5 110B Chat52#693
4Moonshot v1 8K50.5#622
5DeepSeek V2 Chat50.2#572
6GPT-4 Turbo (Preview)50#416
7Qwen 1.5 72B Chat46.5#782
8GPT-4 Turbo46.2#417
9GLM-445.2#647
10internlm2-chat-7B42.2#1113
11Yi Chat 34B41.5#950
12internlm2-chat-20B40.5#988
13Qwen 1.5 14B Chat38.2#976
14Qwen 1.5 7B Chat36.2#1292
15Llama 3 70B Instruct34#640

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-subjective-language-compassbench-2404 · How It Works · Data refreshed daily, snapshot 2026-11-05.