zephyr-orpo-141B-A35B-v0.1 — benchmark results
Hugging Face H4's ORPO preference-tuned Mixtral 8x22B (141B total), built with Argilla and KAIST. Provider: HuggingFace. Released 2024-04-10. Access: Open.
Unified ELO 1578 ± 38, rank #539 of 1776 rated models, from 8 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 17.11 | Score | 94.3 |
| BenchBench | 84.14 | Aggregate Score (%) | 91.2 |
| Open LLM Leaderboard - BBH | 47.5 | Score | 87.4 |
| Open LLM Leaderboard - MMLU-Pro | 39.85 | Score | 84.7 |
| Open LLM Leaderboard - MuSR | 14.72 | Score | 79.9 |
| Open LLM Leaderboard - IFEval | 65.11 | Score | 77.4 |
| Open LLM Leaderboard - MATH Level 5 | 20.47 | Score | 71.8 |
| Chatbot Arena (Text) | 1212 | Elo | 19.8 |
Interactive version: theaggregate.ai/model?slug=zephyr-orpo-141b-a35b-v0-1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.