manticore-13B-chat-pyg: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1307 ± 16, rank #8608 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Abstract Algebra | 39 | Accuracy (%) | 98 |
| MMLU-by-task - ARC Challenge | 56.74 | Accuracy (%) | 78.2 |
| MMLU-by-task - TruthfulQA MC1 | 34.27 | Accuracy (%) | 76.7 |
| MMLU-by-task - Econometrics | 31.58 | Accuracy (%) | 73.2 |
| MMLU-by-task - HellaSwag | 61.93 | Accuracy (%) | 72.4 |
| MMLU-by-task - Anatomy | 48.89 | Accuracy (%) | 71.6 |
| MMLU-by-task - College Computer Science | 45 | Accuracy (%) | 71.3 |
| MMLU-by-task - TruthfulQA MC2 | 48.76 | Accuracy (%) | 69.7 |
| MMLU-by-task - Professional Law | 40.87 | Accuracy (%) | 68.8 |
| MMLU-by-task - Public Relations | 60.91 | Accuracy (%) | 68.5 |
| MMLU-by-task - US Foreign Policy | 78 | Accuracy (%) | 67.9 |
| MMLU-by-task - High School Computer Science | 52 | Accuracy (%) | 63.6 |
Interactive version: theaggregate.ai/model?slug=manticore-13b-chat-pyg · How It Works · Data refreshed daily, snapshot 2026-11-08.