Ring-1T Report - CMMLU: leaderboard

CMMLU: Chinese multi-subject knowledge questions, accuracy in percent. From Table 1 of inclusionAI's Ring-1T technical report, comparing Ring-1T with DeepSeek-V3.1-Terminus (Thinking), Qwen3-235B-A22B-Thinking-2507, Gemini 2.5 Pro and GPT-5 Thinking (High), evaluated with a 32K context window. Baselines use official hyperparameters for open models and vendor-recommended settings for APIs, and where an official score exists the report keeps the higher of its reproduction and the official figure.

Metric: CMMLU. Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 235B A22B 2507 (Thinking)90.64#460
2DeepSeek V3.1 Terminus (Thinking)89.2#442 (DeepSeek V3.1 Terminus)
3Ring-1T89.14#628
4Gemini 2.5 Pro88.83#262
5GPT-5 (High)87.09#163 (GPT-5)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=ring-1t-report-cmmlu · How It Works · Data refreshed daily, snapshot 2026-11-12.