Orca-2-13B: benchmark results

Microsoft's Orca 2 13B, a research-only model built on the Llama 2 13B base for single-turn reasoning, reading comprehension, math and summarization tasks, not yet tuned for chat. Provider: Microsoft. Released 2023-11-14. Access: Open.

Aggregate Rating 1316 ± 34, rank #1448 of 1656 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MuSR51.3Score99.2
Hallucinations Leaderboard44.31Average Task Score (score)55.3
Open LLM Leaderboard - BBH48.84Score43.7
pfgen-bench - Completion Mode - Fluency0.51Fluency Score38
Open CoT - LSAT Logical Reasoning7.84CoT Gain (%)37
Open CoT - LogiQA 24.58CoT Gain (%)36.3
pfgen-bench - Completion Mode - Helpfulness0.07Helpfulness Score36.1
Open LLM Leaderboard - GPQA28.02Score35.2
pfgen-bench - Completion Mode - Score0.4pfgen Score (mean of three)34.5
pfgen-bench - Completion Mode - Truthfulness0.63Truthfulness Score31.6
Open LLM Leaderboard - MMLU-Pro27.49Score29.9
Open LLM Leaderboard - IFEval31.28Score28.9

Interactive version: theaggregate.ai/model?slug=orca-2-13b · How It Works · Data refreshed daily, snapshot 2026-10-20.