gemma-2-Ifable-9B: benchmark results
ifable's SimPO creative-writing tune of Gemma 2 9B on Gutenberg DPO plus proprietary data; topped EQ-Bench creative writing in September 2024. Provider: Google. Released 2024-09-10. Access: Open.
Unified ELO 1522 ± 1, rank #589 of 1392 rated models, from 12 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 12.19 | Score | 84.9 |
| Open LLM Leaderboard - BBH | 41.03 | Score | 80.1 |
| Open LLM Leaderboard - MMLU-Pro | 35.85 | Score | 76.7 |
| Open LLM Leaderboard - MATH Level 5 | 13.97 | Score | 60.2 |
| Open LLM Leaderboard - MuSR | 8.52 | Score | 40.8 |
| UGI - Writing | 29.13 | Writing Score | 33.8 |
| Open LLM Leaderboard - IFEval | 29.84 | Score | 27.1 |
| EQ-Bench Creative Writing v3 | 988.3 | Elo | 24 |
| Creative Writing v3 | 1099.9 | Elo score (self-reported) | 22.7 |
| UGI - Natural Intelligence | 15.75 | NatInt Score | 22.4 |
| UGI - Willingness (W/10) | 2.8 | W/10 Score | 20.6 |
| UGI Leaderboard | 21.64 | UGI Score | 14.6 |
Interactive version: theaggregate.ai/model?slug=gemma-2-ifable-9b · How It Works · Data refreshed daily, snapshot 2026-09-05.