Gemmasutra-Mini-2B-v1: benchmark results

Provider: BeaverAI. Released 2024-08-03. Access: Open.

Aggregate Rating 1320 ± 50, rank #8283 of 10552 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
UGI - Willingness (W/10)5.2W/10 Score43.1
Open LLM Leaderboard - GPQA27.1Score25.8
Open LLM Leaderboard - MMLU-Pro20.55Score21.9
Open LLM Leaderboard - IFEval25.49Score21.8
Open LLM Leaderboard - MATH Level 53.78Score21.7
Open LLM Leaderboard - BBH35.75Score20.2
UGI Leaderboard25.19UGI Score19.1
UGI - Writing21.7Writing Score16.1
Open LLM Leaderboard - MuSR34.9Score12.2
UGI - Natural Intelligence6.31NatInt Score2.4

Interactive version: theaggregate.ai/model?slug=gemmasutra-mini-2b-v1 · How It Works · Data refreshed daily, snapshot 2026-11-16.