Gemma2-9B-IT-Simpo-Infinity-Preference: benchmark results
BAAI's SimPO preference-optimization fine-tune of Gemma 2 9B IT on its Infinity-Preference dataset. Provider: Other. Released 2024-08-28. Access: Open.
Unified ELO 1499 ± 1, rank #767 of 1553 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 42.89 | Average Score (%) | 84.9 |
| Open LLM Leaderboard - GPQA | 11.97 | Score | 84.3 |
| Open LLM Leaderboard - BBH | 42.19 | Score | 81.2 |
| Open LLM Leaderboard - MMLU-Pro | 31.88 | Score | 69 |
| Open LLM Leaderboard - MATH Level 5 | 9.74 | Score | 46.5 |
| Open LLM Leaderboard - MuSR | 8.1 | Score | 38 |
| Open LLM Leaderboard - IFEval | 31.76 | Score | 29.4 |
Interactive version: theaggregate.ai/model?slug=gemma2-9b-it-simpo-infinity-preference · How It Works · Data refreshed daily, snapshot 2026-09-08.