supermario-v2 (Publisher: janhq): benchmark results

Provider: Other.

Aggregate Rating 1445 ± 36, rank #3977 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K72.18Accuracy (%) (5-shot)97.3
Open LLM Leaderboard v1 - HellaSwag86.51Normalized accuracy (%) (10-shot)81.5
Open LLM Leaderboard v1 - ARC Challenge68.52Normalized accuracy (%) (25-shot)80.6
Open LLM Leaderboard v1 - WinoGrande81.37Accuracy (%) (5-shot)78.9
Open LLM Leaderboard v1 - MMLU64.88Accuracy (%) (5-shot)77.9
Open LLM Leaderboard v1 - TruthfulQA MC260.58MC2 (%) (0-shot)76.2

Interactive version: theaggregate.ai/model?slug=supermario-v2-publisher-janhq · How It Works · Data refreshed daily, snapshot 2026-11-08.