Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ: benchmark results
TheBloke's GPTQ publication of Manticore 13B Chat Pyg Guanaco, whose original release is Monero/Manticore-13b-Chat-Pyg-Guanaco. Conversion publication is credited separately from the original model creator. Quantization method does not establish a single effective bit width or exact evaluated branch for this catalog row. The card describes a SuperHOT merge with extended-context inference requirements; its extension is not treated as the original model’s native context. Provider: TheBloke. Access: Open.
Aggregate Rating 1258 ± 16, rank #9176 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - TruthfulQA MC2 | 52.55 | Accuracy (%) | 87.8 |
| MMLU-by-task - TruthfulQA MC1 | 35.01 | Accuracy (%) | 80.1 |
| MMLU-by-task - Econometrics | 31.58 | Accuracy (%) | 73.2 |
| MMLU-by-task - High School Computer Science | 48 | Accuracy (%) | 57.3 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 52.55 | MC2 (%) (0-shot) | 56.5 |
| MMLU-by-task - HellaSwag | 59.63 | Accuracy (%) | 55.3 |
| MMLU-by-task - ARC Challenge | 50.51 | Accuracy (%) | 53.5 |
| MMLU-by-task - US Foreign Policy | 68 | Accuracy (%) | 51.8 |
| MMLU-by-task - Business Ethics | 47 | Accuracy (%) | 50 |
| MMLU-by-task - Professional Law | 35.66 | Accuracy (%) | 50 |
| MMLU-by-task - Human Aging | 53.81 | Accuracy (%) | 49.4 |
| MMLU-by-task - Astronomy | 42.11 | Accuracy (%) | 48.2 |
Interactive version: theaggregate.ai/model?slug=manticore-13b-chat-pyg-guanaco-superhot-8k-gptq · How It Works · Data refreshed daily, snapshot 2026-11-08.