mamba-2.8B-hf: benchmark results

Provider: State Space Models. Released 2024-03-05. Access: Open.

Aggregate Rating 945 ± 44, rank #1656 of 1656 rated models, from 53 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BABILong (NIAH, v0, 0k)70QA1–5 Mean Accuracy (%)72.4
RoBench-25 (Recovery Instruction) - No Trigger0.28Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger A0.22Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger B0.08Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger F0.15Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Recovery Instruction) - Trigger G0.28Clipped Heidke skill score (0-1; chance-corrected accuracy o40
RoBench-25 (Awareness Instruction) - No Trigger0.19Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger A0.18Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger B0.07Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger C0.15Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger D0.08Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3
RoBench-25 (Awareness Instruction) - Trigger E0.14Clipped Heidke skill score (0-1; chance-corrected accuracy o33.3

Interactive version: theaggregate.ai/model?slug=mamba-2-8b-hf · How It Works · Data refreshed daily, snapshot 2026-10-20.