OpenCompass Language - Content Summarization - English (CompassBench 2405): leaderboard
OpenCompass CompassBench 2405 edition (file dated 2024-06-12): content summarization sub-task of the language category, English questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Score 0-100, higher is better.
Metric: Score (%). Source: rank.opencompass.org.cn. 39 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Command-R+ | 42.7 | #869 |
| 2 | internlm2-chat-20B | 38.2 | #988 |
| 3 | internlm2-chat-7B | 37.8 | #1113 |
| 4 | chatglm3-6B | 35.6 | #1416 |
| 5 | Llama 3 70B Instruct | 32.2 | #640 |
| 6 | Mixtral 8x22B Instruct | 30.6 | #738 |
| 7 | Mixtral 8x7B Instruct | 30.4 | #1085 |
| 8 | DBRX | 30 | #1041 |
| 9 | Llama 3 8B Instruct | 29.7 | #1116 |
| 10 | Qwen 1.5 72B Chat | 29.5 | #782 |
| 11 | Qwen 1.5 110B Chat | 29 | #693 |
| 12 | Qwen 1.5 7B Chat | 28.8 | #1292 |
| 13 | Qwen 1.5 14B Chat | 28.5 | #976 |
| 14 | GPT-3.5 Turbo | 26.4 | #858 |
| 15 | Mistral Large | 25.7 | #713 |
Interactive version: theaggregate.ai/benchmark?slug=opencompass-language-content-summarization-english-compassbench-2405 · How It Works · Data refreshed daily, snapshot 2026-11-05.