gemma-2-9B-it-SimPO: benchmark results
Princeton NLP's SimPO reference-free preference-optimization research tune of Gemma 2 9B IT on UltraFeedback-ArmoRM data. Provider: Google. Released 2024-07-16. Access: Open.
Unified ELO 1561 ± 1, rank #398 of 1392 rated models, from 29 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AlpacaEval 2.0 | 72.35 | LC Win Rate (%) | 96.8 |
| Open Korean LLM Leaderboard | 47.27 | Average Score (%) | 94.9 |
| Open CoT - LSAT Analytical Reasoning | 8.26 | CoT Gain (%) | 89.3 |
| WildBench | 53.28 | WB Score Task-Macro | 87.1 |
| Open LLM Leaderboard - GPQA | 11.41 | Score | 82.7 |
| Open CoT - LogiQA | 6.55 | CoT Gain (%) | 82.1 |
| Open LLM Leaderboard - BBH | 40.09 | Score | 79.2 |
| BenchBench | 73.28 | Aggregate Score (%) | 77.9 |
| Open LLM Leaderboard - MMLU-Pro | 33.06 | Score | 73.2 |
| Open CoT - LogiQA 2 | 9.99 | CoT Gain (%) | 69.1 |
| Open CoT Leaderboard | 9.06 | Average CoT Gain (%) | 61.8 |
| Open CoT - LSAT Logical Reasoning | 11.57 | CoT Gain (%) | 56.5 |
Interactive version: theaggregate.ai/model?slug=gemma-2-9b-it-simpo · How It Works · Data refreshed daily, snapshot 2026-09-05.