Gemmasutra-9B-v1: benchmark results

TheDrummer's roleplay-focused community variant of Gemma 2 9B, tuned for uninhibited creative output. Provider: Other. Released 2024-07-17. Access: Open.

Unified ELO 1528 ± 1, rank #554 of 1392 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard49.32Average Score (%)97.3
Open LLM Leaderboard - MuSR20.94Score96.3
Open LLM Leaderboard - BBH41.2Score80.3
Open LLM Leaderboard - MMLU-Pro33.83Score74.2
Open LLM Leaderboard - GPQA8.05Score67.9
UGI - Willingness (W/10)6.8W/10 Score67
UGI Leaderboard37.72UGI Score59.3
Open LLM Leaderboard - MATH Level 58.31Score41.9
UGI - Writing29.01Writing Score33.4
Open LLM Leaderboard - IFEval24.16Score18.4
UGI - Natural Intelligence14.96NatInt Score18.3

Interactive version: theaggregate.ai/model?slug=gemmasutra-9b-v1 · How It Works · Data refreshed daily, snapshot 2026-09-05.