Gemmasutra-Mini-2B-v1 — benchmark results

Provider: Other. Released 2024-08-03. Access: Open.

Unified ELO 1301 ± 59, rank #1536 of 1776 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
UGI - Willingness (W/10)5.2W/10 Score41.4
Open LLM Leaderboard - GPQA2.8Score25.8
Open LLM Leaderboard - MMLU-Pro11.72Score21.9
Open LLM Leaderboard - IFEval25.49Score21.8
Open LLM Leaderboard - MATH Level 53.78Score21.8
Open LLM Leaderboard - BBH9.81Score19.8
UGI Leaderboard25.19UGI Score19.6
UGI - Writing21.7Writing Score16.6
Open LLM Leaderboard - MuSR1.19Score3.3
UGI - Natural Intelligence6.31NatInt Score2.4

Interactive version: theaggregate.ai/model?slug=gemmasutra-mini-2b-v1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.