OpenCompass Reasoning - Inductive - English (CompassBench 2404): leaderboard

OpenCompass CompassBench 2404 edition (file dated 2024-05-09): inductive reasoning sub-task of the reasoning category, English questions. CompassBench is OpenCompass's periodic evaluation of chat models on a private question set; each edition is a separate board. Edition 2405 republished 20 of these results for the same task set; those models appear on that board only. Score 0-100, higher is better.

Metric: Score (%). Source: rank.opencompass.org.cn. Saturation forecast: Estimated already saturated. 31 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4 Turbo (Preview)47.9#416
2OrionStar-Yi-34B-Chat34.2#872
3Baichuan2-13B-Chat32.3#1210
4Yi Chat 34B31.7#950
5deepseek-llm-7B-chat29.2#1320
6vicuna-13B-v1.5-16k27.7#1417
7Vicuna-7B-v1.5-16k24.3#1470
8Qwen-7B Chat23.2#1353
9Qwen-72B-Chat21.8#835
10Baichuan2-7B-Chat21.8#1384
11Qwen-14B-Chat20.8#1161
12Llama 2 70B Chat20#1275
13Yi 6B (Chat)17.7#1379
14Llama 2 13B Chat17.5#1414
15Llama 2 7B Chat16.3#1478

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=opencompass-reasoning-inductive-english-compassbench-2404 · How It Works · Data refreshed daily, snapshot 2026-11-05.