gemma-2-9B-it-SimPO — benchmark results
Princeton NLP's SimPO reference-free preference-optimization research tune of Gemma 2 9B IT on UltraFeedback-ArmoRM data. Provider: Google. Released 2024-07-16. Access: API.
Unified ELO 1518 ± 43, rank #738 of 1776 rated models, from 17 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 774.57 | Average Score (%) | 97.9 |
| AlpacaEval 2.0 | 72.35 | LC Win Rate (%) | 96.8 |
| Open CoT - LSAT Analytical Reasoning | 8.26 | CoT Gain (%) | 89.3 |
| WildBench | 53.28 | WB Score Task-Macro | 87.1 |
| Open LLM Leaderboard - GPQA | 11.41 | Score | 82.7 |
| Open CoT - LogiQA | 6.55 | CoT Gain (%) | 82.1 |
| Open LLM Leaderboard - BBH | 40.09 | Score | 79.2 |
| BenchBench | 73.28 | Aggregate Score (%) | 77.9 |
| Open LLM Leaderboard - MMLU-Pro | 33.06 | Score | 73.2 |
| Open CoT - LogiQA 2 | 9.99 | CoT Gain (%) | 69.1 |
| Open CoT Leaderboard | 9.06 | Average CoT Gain (%) | 61.8 |
| Open CoT - LSAT Logical Reasoning | 11.57 | CoT Gain (%) | 56.5 |
Interactive version: theaggregate.ai/model?slug=gemma-2-9b-it-simpo · How the rankings work · Data refreshed daily, snapshot 2026-07-22.