Llemma-MetaMath-7B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1332 ± 30, rank #8116 of 10916 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K60.96Accuracy (%) (5-shot)73.3
Open LLM Leaderboard v1 - MMLU47.66Accuracy (%) (5-shot)26.6
GR-Ben - Chemistry22.8F1 (%) of first-error identification: the harmonic mean of t23.8
GR-Ben - Computer Science18.1F1 (%) of first-error identification: the harmonic mean of t23.8
GR-Ben - Inductive Reasoning18.1F1 (%) of first-error identification: the harmonic mean of t23.8
Open LLM Leaderboard v1 - ARC Challenge46.5Normalized accuracy (%) (25-shot)21.6
MathBench24.9Average Score21.2
PRMBench50.5Overall Score16
Open LLM Leaderboard v1 - WinoGrande62.75Accuracy (%) (5-shot)15.7
Open LLM Leaderboard v1 - HellaSwag61.69Normalized accuracy (%) (10-shot)15.6
GR-Ben - Abductive Reasoning8.3F1 (%) of first-error identification: the harmonic mean of t14.3
GR-Ben - Deductive Reasoning11.4F1 (%) of first-error identification: the harmonic mean of t14.3

Interactive version: theaggregate.ai/model?slug=llemma-metamath-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.