Gemmasutra-Mini-2B-v1: benchmark results
Provider: BeaverAI. Released 2024-08-03. Access: Open.
Aggregate Rating 1320 ± 50, rank #8283 of 10552 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| UGI - Willingness (W/10) | 5.2 | W/10 Score | 43.1 |
| Open LLM Leaderboard - GPQA | 27.1 | Score | 25.8 |
| Open LLM Leaderboard - MMLU-Pro | 20.55 | Score | 21.9 |
| Open LLM Leaderboard - IFEval | 25.49 | Score | 21.8 |
| Open LLM Leaderboard - MATH Level 5 | 3.78 | Score | 21.7 |
| Open LLM Leaderboard - BBH | 35.75 | Score | 20.2 |
| UGI Leaderboard | 25.19 | UGI Score | 19.1 |
| UGI - Writing | 21.7 | Writing Score | 16.1 |
| Open LLM Leaderboard - MuSR | 34.9 | Score | 12.2 |
| UGI - Natural Intelligence | 6.31 | NatInt Score | 2.4 |
Interactive version: theaggregate.ai/model?slug=gemmasutra-mini-2b-v1 · How It Works · Data refreshed daily, snapshot 2026-11-16.