Mengzi3-8B-Chat: benchmark results
Langboat's Apache-2.0 8B Chinese-focused chat model (2024), built on the Llama architecture and trained on trillions of multilingual tokens. Provider: Langboat. Released 2024-09-14. Access: Open.
Unified ELO 1487 ± 1, rank #747 of 1392 rated models, from 14 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Chinese LLM - GSM8K | 58.98 | Accuracy (%) | 82.2 |
| Open Chinese LLM - TruthfulQA MC | 58.96 | Accuracy (%) | 79.8 |
| Open Chinese LLM Leaderboard | 59.73 | Average Score (%) | 69.1 |
| Open Chinese LLM - HellaSwag | 62.6 | Accuracy (%) | 68.2 |
| Open LLM Leaderboard - IFEval | 51.4 | Score | 61.3 |
| Open Chinese LLM - C-Eval Semantic | 72.72 | Accuracy (%) | 60.2 |
| Open Chinese LLM - CMMLU | 53.4 | Accuracy (%) | 49.9 |
| Open LLM Leaderboard - MATH Level 5 | 9.06 | Score | 44.4 |
| Open Chinese LLM - ARC Challenge | 50.94 | Accuracy (%) | 44.2 |
| Open LLM Leaderboard - MuSR | 9.04 | Score | 43.7 |
| Open LLM Leaderboard - MMLU-Pro | 23.8 | Score | 41.7 |
| Open LLM Leaderboard - BBH | 25.19 | Score | 38.4 |
Interactive version: theaggregate.ai/model?slug=mengzi3-8b-chat · How It Works · Data refreshed daily, snapshot 2026-09-05.