Manticore-13B-Chat-Pyg-Guanaco: benchmark results

Provider: Other.

Aggregate Rating 1294 ± 18, rank #8827 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Abstract Algebra40Accuracy (%)98.9
MMLU-by-task - TruthfulQA MC136.47Accuracy (%)87.8
MMLU-by-task - TruthfulQA MC252.29Accuracy (%)86.3
MMLU-by-task - Econometrics35.09Accuracy (%)84.6
MMLU-by-task - High School Mathematics29.63Accuracy (%)72.9
MMLU-by-task - Professional Accounting40.78Accuracy (%)72
MMLU-by-task - Global Facts36Accuracy (%)70
MMLU-by-task - HellaSwag61.49Accuracy (%)68.3
MMLU-by-task - College Computer Science43Accuracy (%)64.3
MMLU-by-task - Machine Learning35.71Accuracy (%)64.2
MMLU-by-task - US Foreign Policy76Accuracy (%)63.7
MMLU-by-task - Human Aging59.19Accuracy (%)62.5

Interactive version: theaggregate.ai/model?slug=manticore-13b-chat-pyg-guanaco · How It Works · Data refreshed daily, snapshot 2026-11-08.