mamba-gpt-3B-v4: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1170 ± 16, rank #9766 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Physics33.33Accuracy (%)83.7
MMLU-by-task - Abstract Algebra31Accuracy (%)60.2
MMLU-by-task - Elementary Mathematics29.89Accuracy (%)56.4
MMLU-by-task - High School Mathematics27.41Accuracy (%)54.7
MMLU-by-task - Global Facts32Accuracy (%)44.3
MMLU-by-task - Moral Scenarios24.8Accuracy (%)41.6
MMLU-by-task - College Computer Science34Accuracy (%)39.6
MMLU-by-task - High School Statistics33.33Accuracy (%)38.3
MMLU-by-task - College Mathematics30Accuracy (%)38.1
MMLU-by-task - HellaSwag53.49Accuracy (%)36.6
MMLU-by-task - High School European History33.94Accuracy (%)36.1
MMLU-by-task - Public Relations39.09Accuracy (%)35.8

Interactive version: theaggregate.ai/model?slug=mamba-gpt-3b-v4 · How It Works · Data refreshed daily, snapshot 2026-11-08.