MAmmoTH2-8x7B-Plus: benchmark results
TIGER-Lab's (U. Waterloo) Mixtral 8x7B tune on 10M web-mined WebInstruct pairs, with extra public instruction data for reasoning and chat (May 2024). Provider: CMU. Released 2024-05-06. Access: Open.
Aggregate Rating 1520 ± 29, rank #2065 of 10916 rated models, from 11 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Science Leaderboard | 55.5 | Average Accuracy (%) | 90.9 |
| TheoremQA | 34.1 | Score (%) | 90.9 |
| Open Chinese LLM - GSM8K | 56.56 | Accuracy (%) | 79 |
| Open Chinese LLM - TruthfulQA MC | 58.49 | Accuracy (%) | 76.9 |
| Open Chinese LLM Leaderboard | 63.17 | Official Nonzero-Task Mean (%) | 76 |
| Open Chinese LLM - ARC Challenge | 57.42 | Accuracy (%) | 74.6 |
| MixEval | 51.8 | Score | 70.6 |
| Open Chinese LLM - C-Eval Semantic | 77.93 | Accuracy (%) | 67 |
| Open Chinese LLM - HellaSwag | 61.38 | Accuracy (%) | 62.6 |
| Open Chinese LLM - CMMLU | 56.53 | Accuracy (%) | 61.5 |
| Open Chinese LLM - WinoGrande | 62.19 | Accuracy (%) | 37.7 |
Interactive version: theaggregate.ai/model?slug=mammoth2-8x7b-plus · How It Works · Data refreshed daily, snapshot 2026-11-08.