Open Chinese LLM - CMMLU: leaderboard

Metric: Accuracy (%). Source: huggingface.co. 338 models tracked.

Top models

#ModelScore
1Smaug-Llama-3-70B-Instruct80.7
2Qwen 2 72B78.66
3Qwen 2 72B Instruct78.4
4Higgs-Llama-3-70B75.33
5free-evo-qwen72B-v0.8-re73.88
6TW3-JRGL-v273.73
7Llama 3 70B Synthia V3.573.46
8Rhea-72B-v0.573.31
9Meta-LLama-3-Cat-Smaug-LLama-70B72.48
10autotrain-llama3-70B-orpo-v172.42
11dolphin-2.9.1-llama-3-70B72.34
12Smaug-72B-v0.172.32
13Llama 3 70B Japanese Suzume Vector V0.172.14
14Llama3-TenyxChat-70B72.02
15Le_Triomphant-ECE-TW371.86

Interactive version: theaggregate.ai/benchmark?slug=open-chinese-llm-cmmlu · How It Works · Data refreshed daily, snapshot 2026-09-05.