orca-mini-v2.7B: benchmark results
Provider: pankajmathur. Access: Open.
Aggregate Rating 1244 ± 15, rank #9296 of 10916 rated models, from 74 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Global Facts | 35 | Accuracy (%) | 64.2 |
| MMLU-by-task - TruthfulQA MC1 | 29.38 | Accuracy (%) | 54.6 |
| MMLU-by-task - Abstract Algebra | 30 | Accuracy (%) | 52.2 |
| MMLU-by-task - International Law | 61.98 | Accuracy (%) | 50.5 |
| MMLU-by-task - Clinical Knowledge | 47.17 | Accuracy (%) | 49.4 |
| MMLU-by-task - High School Computer Science | 43 | Accuracy (%) | 49.4 |
| MMLU-by-task - College Computer Science | 37 | Accuracy (%) | 46.6 |
| MMLU-by-task - TruthfulQA MC2 | 43.86 | Accuracy (%) | 45.8 |
| MMLU-by-task - College Mathematics | 31 | Accuracy (%) | 45.5 |
| MMLU-by-task - Computer Security | 55 | Accuracy (%) | 45.3 |
| MMLU-by-task - Professional Psychology | 41.5 | Accuracy (%) | 45 |
| MMLU-by-task - ARC Challenge | 48.21 | Accuracy (%) | 44.9 |
Interactive version: theaggregate.ai/model?slug=orca-mini-v2-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.