Gemma2-9B-IT-Simpo-Infinity-Preference — benchmark results
BAAI's SimPO preference-optimization fine-tune of Gemma 2 9B IT on its Infinity-Preference dataset. Provider: Other. Released 2024-08-28. Access: Open.
Unified ELO 1461 ± 58, rank #953 of 1776 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 677.74 | Average Score (%) | 95.3 |
| Open LLM Leaderboard - GPQA | 11.97 | Score | 84.3 |
| Open LLM Leaderboard - BBH | 42.19 | Score | 81.2 |
| Open LLM Leaderboard - MMLU-Pro | 31.88 | Score | 69.1 |
| Open LLM Leaderboard - MATH Level 5 | 9.74 | Score | 46.5 |
| Open LLM Leaderboard - MuSR | 8.1 | Score | 38 |
| Open LLM Leaderboard - IFEval | 31.76 | Score | 29.4 |
Interactive version: theaggregate.ai/model?slug=gemma2-9b-it-simpo-infinity-preference · How the rankings work · Data refreshed daily, snapshot 2026-07-22.