gemma-2-Ifable-9B: benchmark results
ifable's SimPO creative-writing tune of Gemma 2 9B on Gutenberg DPO plus proprietary data; topped EQ-Bench creative writing in September 2024. Provider: Google. Released 2024-09-10. Access: Open.
Aggregate Rating 1535 ± 30, rank #1902 of 10916 rated models, from 12 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 34.14 | Score | 84.9 |
| Open LLM Leaderboard - BBH | 58.66 | Score | 79.8 |
| Open LLM Leaderboard - MMLU-Pro | 42.26 | Score | 76.7 |
| Open LLM Leaderboard - MATH Level 5 | 13.97 | Score | 60.1 |
| Open LLM Leaderboard - MuSR | 40.53 | Score | 46.5 |
| UGI - Writing | 29.13 | Writing Score | 33.1 |
| Open LLM Leaderboard - IFEval | 29.84 | Score | 27.1 |
| EQ-Bench Creative Writing v3 | 988.3 | Elo | 24 |
| Creative Writing v3 | 1099.9 | Elo score (imported) | 22.7 |
| UGI - Natural Intelligence | 15.75 | NatInt Score | 22 |
| UGI - Willingness (W/10) | 2.8 | W/10 Score | 20.9 |
| UGI Leaderboard | 21.64 | UGI Score | 14.3 |
Interactive version: theaggregate.ai/model?slug=gemma-2-ifable-9b · How It Works · Data refreshed daily, snapshot 2026-11-08.