gemma-2-Ifable-9B — benchmark results

ifable's SimPO creative-writing tune of Gemma 2 9B on Gutenberg DPO plus proprietary data; topped EQ-Bench creative writing in September 2024. Provider: Google. Released 2024-09-10. Access: API.

Unified ELO 1468 ± 32, rank #919 of 1776 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - GPQA12.19Score84.9
Open LLM Leaderboard - BBH41.03Score80.1
Open LLM Leaderboard - MMLU-Pro35.85Score76.7
Open LLM Leaderboard - MATH Level 513.97Score60.2
Open LLM Leaderboard - MuSR8.52Score40.8
UGI - Writing29.13Writing Score34.2
Open LLM Leaderboard - IFEval29.84Score27.1
Creative Writing v31134.5Elo score (self-reported)24.8
EQ-Bench Creative Writing v3988.3Elo24
UGI - Natural Intelligence15.75NatInt Score22.6
UGI - Willingness (W/10)2.8W/10 Score20.1
UGI Leaderboard21.64UGI Score14.6

Interactive version: theaggregate.ai/model?slug=gemma-2-ifable-9b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.