zephyr-orpo-141B-A35B-v0.1: benchmark results
Hugging Face H4's ORPO preference-tuned Mixtral 8x22B (141B total), built with Argilla and KAIST. Provider: HuggingFace. Released 2024-04-10. Access: Open.
Unified ELO 1544 ± 1, rank #466 of 1392 rated models, from 18 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 17.11 | Score | 94.3 |
| BenchBench | 84.14 | Aggregate Score (%) | 91.2 |
| Open LLM Leaderboard - BBH | 47.5 | Score | 87.4 |
| Open LLM Leaderboard - MMLU-Pro | 39.85 | Score | 84.7 |
| Open LLM Leaderboard - MuSR | 14.72 | Score | 79.9 |
| Open LLM Leaderboard - IFEval | 65.11 | Score | 77.4 |
| Open LLM Leaderboard - MATH Level 5 | 20.47 | Score | 71.8 |
| Chatbot Arena (Text - English) | 1240 | Arena Score | 19.5 |
| Chatbot Arena (Text - Instruction Following) | 1193 | Arena Score | 19 |
| Chatbot Arena (Text) | 1212 | Elo | 18.7 |
| Chatbot Arena (Text - Math) | 1196 | Arena Score | 17.4 |
| Chatbot Arena (Text - Creative Writing) | 1168 | Arena Score | 17.1 |
Interactive version: theaggregate.ai/model?slug=zephyr-orpo-141b-a35b-v0-1 · How It Works · Data refreshed daily, snapshot 2026-09-05.