Gemmalpaca-2B: benchmark results

Provider: mlabonne. Access: Open.

Aggregate Rating 1247 ± 31, rank #9281 of 10916 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K10.69Accuracy (%) (5-shot)31.6
Open LLM Leaderboard v1 - ARC Challenge48.72Normalized accuracy (%) (25-shot)23.5
Open LLM Leaderboard v1 - HellaSwag71.36Normalized accuracy (%) (10-shot)21.5
Open LLM Leaderboard v1 - WinoGrande65.59Accuracy (%) (5-shot)19.1
Open LLM Leaderboard v1 - MMLU36.3Accuracy (%) (5-shot)18.8
Open LLM Leaderboard v1 - TruthfulQA MC241.24MC2 (%) (0-shot)16.5
YALL Nous Leaderboard35.52Average5.1

Interactive version: theaggregate.ai/model?slug=gemmalpaca-2b · How It Works · Data refreshed daily, snapshot 2026-11-08.