Gemmasutra-9B-v1 — benchmark results

TheDrummer's roleplay-focused community variant of Gemma 2 9B, tuned for uninhibited creative output. Provider: Other. Released 2024-07-17. Access: Open.

Unified ELO 1533 ± 69, rank #675 of 1776 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard795.55Average Score (%)99.3
Open LLM Leaderboard - MuSR20.94Score96.3
Open LLM Leaderboard - BBH41.2Score80.3
Open LLM Leaderboard - MMLU-Pro33.83Score74.2
Open LLM Leaderboard - GPQA8.05Score67.9
UGI - Willingness (W/10)6.8W/10 Score66.6
UGI Leaderboard37.72UGI Score59.8
Open LLM Leaderboard - MATH Level 58.31Score41.9
UGI - Writing29.01Writing Score33.8
UGI - Natural Intelligence14.96NatInt Score18.5
Open LLM Leaderboard - IFEval24.16Score18.3

Interactive version: theaggregate.ai/model?slug=gemmasutra-9b-v1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.