mamba-gpt-3B-v2: benchmark results

Provider: Other.

Aggregate Rating 1148 ± 17, rank #9991 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - High School Physics39.74Accuracy (%)91.3
MMLU-by-task - College Mathematics32Accuracy (%)53.7
MMLU-by-task - Machine Learning30.36Accuracy (%)39
MMLU-by-task - Business Ethics40Accuracy (%)38.5
MMLU-by-task - Conceptual Physics34.04Accuracy (%)36.9
MMLU-by-task - Global Facts31Accuracy (%)36.8
MMLU-by-task - HellaSwag52.85Accuracy (%)35.4
MMLU-by-task - College Physics22.55Accuracy (%)34.3
MMLU-by-task - Professional Accounting28.37Accuracy (%)34.2
MMLU-by-task - Moral Scenarios24.36Accuracy (%)32.6
MMLU-by-task - ARC Challenge38.65Accuracy (%)32.3
MMLU-by-task - Miscellaneous30.91Accuracy (%)31.2

Interactive version: theaggregate.ai/model?slug=mamba-gpt-3b-v2 · How It Works · Data refreshed daily, snapshot 2026-11-08.