HELM CLEVA - Cleva Summarization: leaderboard

The "Cleva Summarization" subtask of HELM CLEVA. Stanford HELM's run of CLEVA, the Chinese Language Models Evaluation Platform: Chinese-language scenarios spanning knowledge, reasoning, language understanding and generation, reported as HELM mean win rate across the group's scenarios.

Metric: ROUGE-2 (Chinese). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 4 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4 (0613)33.66#494
2GPT-3.5 Turbo (0613)30.22#1123
3vicuna-13B-v1.327.12#1452
4LLaMA-65B24.71#1305

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-cleva-cleva-summarization · How It Works · Data refreshed daily, snapshot 2026-10-23.