gemma-7B-it-sa-v0.1 [Adapter]: benchmark results

Provider: Google. Access: API.

Aggregate Rating 1329 ± 35, rank #8175 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K24.64Accuracy (%) (5-shot)43.6
Open LLM Leaderboard v1 - TruthfulQA MC247.75MC2 (%) (0-shot)38.6
Open LLM Leaderboard v1 - MMLU54.98Accuracy (%) (5-shot)35.1
Open LLM Leaderboard v1 - ARC Challenge50.77Normalized accuracy (%) (25-shot)25.1
Open LLM Leaderboard v1 - HellaSwag72.3Normalized accuracy (%) (10-shot)22.6
Open LLM Leaderboard v1 - WinoGrande68.03Accuracy (%) (5-shot)22.1

Interactive version: theaggregate.ai/model?slug=gemma-7b-it-sa-v0-1-adapter · How It Works · Data refreshed daily, snapshot 2026-11-08.