orca-mini-v5.8B: benchmark results

Provider: Other. Access: Open.

Unified ELO 1476 ± 19, rank #1501 of 2928 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K67.55Accuracy (%) (5-shot)83.8
Open LLM Leaderboard v1 - MMLU64.97Accuracy (%) (5-shot)79.5
Open LLM Leaderboard v1 - TruthfulQA MC255.04MC2 (%) (0-shot)64.1
Open LLM Leaderboard - IFEval48.06Score55.9
Open LLM Leaderboard - BBH50.64Score51.3
Open LLM Leaderboard v1 - ARC Challenge60.92Normalized accuracy (%) (25-shot)50.3
Open LLM Leaderboard - MATH Level 59.89Score47
Open LLM Leaderboard v1 - HellaSwag81.78Normalized accuracy (%) (10-shot)47
Open LLM Leaderboard - GPQA28.69Score41.8
Open LLM Leaderboard - MuSR40Score41.8
Open LLM Leaderboard - MMLU-Pro30.76Score39.1
Open LLM Leaderboard v1 - WinoGrande73.4Accuracy (%) (5-shot)31.9

Interactive version: theaggregate.ai/model?slug=orca-mini-v5-8b · How It Works · Data refreshed daily, snapshot 2026-09-23.