zephyr-7B-gemma-v0.1: benchmark results
Provider: HuggingFace. Released 2024-03-01. Access: Open.
Unified ELO 1396 ± 1, rank #1155 of 1392 rated models, from 12 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| RewardBench Chat | 95.81 | Accuracy (%) | 67.6 |
| Open LLM Leaderboard - GPQA | 5.93 | Score | 49.7 |
| RewardBench | 67.58 | Score (%) | 48.8 |
| Open LLM Leaderboard - MATH Level 5 | 8.16 | Score | 41.4 |
| Open LLM Leaderboard - BBH | 23.75 | Score | 35.9 |
| RewardBench Reasoning | 74.63 | Accuracy (%) | 33.7 |
| Open LLM Leaderboard - MMLU-Pro | 20.53 | Score | 32.2 |
| Open LLM Leaderboard - IFEval | 33.64 | Score | 31.7 |
| RewardBench Chat Hard | 49.56 | Accuracy (%) | 26.1 |
| RewardBench Prior Sets (0.5 weight) | 51.71 | Score (%) | 25 |
| Open LLM Leaderboard - MuSR | 4.18 | Score | 20.6 |
| RewardBench Safety | 58.24 | Accuracy (%) | 11.7 |
Interactive version: theaggregate.ai/model?slug=zephyr-7b-gemma-v0-1 · How It Works · Data refreshed daily, snapshot 2026-09-05.