autotrain-llama3-70B-orpo-v1: benchmark results
Provider: Other. Released 2024-06-01.
Aggregate Rating 1485 ± 23, rank #828 of 1656 rated models, from 20 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - GSM8K | 85.67 | Accuracy (%) (5-shot) | 99.9 |
| Open LLM Leaderboard v1 - MMLU | 80.11 | Accuracy (%) (5-shot) | 99.6 |
| Open Chinese LLM - CMMLU | 72.42 | Accuracy (%) | 96.4 |
| Open Chinese LLM - GSM8K | 68.84 | Accuracy (%) | 93.2 |
| Open LLM Leaderboard v1 - WinoGrande | 84.29 | Accuracy (%) (5-shot) | 92.8 |
| Open LLM Leaderboard v1 - ARC Challenge | 70.65 | Normalized accuracy (%) (25-shot) | 86.6 |
| Open Chinese LLM - C-Eval Semantic | 87.33 | Accuracy (%) | 84.3 |
| Open Chinese LLM - ARC Challenge | 58.96 | Accuracy (%) | 82.2 |
| Open LLM Leaderboard - BBH | 59.98 | Score | 81.9 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 61.78 | MC2 (%) (0-shot) | 78.2 |
| Open LLM Leaderboard v1 - HellaSwag | 85.99 | Normalized accuracy (%) (10-shot) | 77.9 |
| Open Chinese LLM - HellaSwag | 63.66 | Accuracy (%) | 74 |
Interactive version: theaggregate.ai/model?slug=autotrain-llama3-70b-orpo-v1 · How It Works · Data refreshed daily, snapshot 2026-10-20.