mamba-2.8B-hf: benchmark results

Provider: State Space Models. Released 2024-03-05. Access: Open.

Aggregate Rating 944 ± 45, rank #1640 of 1640 rated models, from 53 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BABILong (NIAH, v0, 0k)70QA1–5 Mean Accuracy (%)72.4
RoBench-25 (Recovery Instruction) - No Trigger0.28Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger A0.22Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger B0.08Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger F0.15Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger G0.28Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Awareness Instruction) - No Trigger0.19Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger A0.18Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger B0.07Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger C0.15Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger D0.08Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger E0.14Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3

Interactive version: theaggregate.ai/model?slug=mamba-2-8b-hf · How It Works · Data refreshed daily, snapshot 2026-10-13.