pankajmathur orca_mini_v3.7B (FP16): benchmark results

Provider: Other.

Aggregate Rating 1319 ± 17, rank #8342 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Conceptual Physics49.36Accuracy (%)86.2
MMLU-by-task - Machine Learning42.86Accuracy (%)85.8
MMLU-by-task - High School European History71.52Accuracy (%)83.1
MMLU-by-task - TruthfulQA MC135.37Accuracy (%)82.6
MMLU-by-task - Clinical Knowledge60.75Accuracy (%)81
MMLU-by-task - Medical Genetics60Accuracy (%)78.5
MMLU-by-task - TruthfulQA MC250.51Accuracy (%)78.4
MMLU-by-task - Econometrics32.46Accuracy (%)77.1
MMLU-by-task - High School World History74.68Accuracy (%)76.7
MMLU-by-task - Management72.82Accuracy (%)75.6
MMLU-by-task - College Physics30.39Accuracy (%)74.7
MMLU-by-task - High School Geography69.7Accuracy (%)74.1

Interactive version: theaggregate.ai/model?slug=pankajmathur-orca-mini-v3-7b-fp16 · How It Works · Data refreshed daily, snapshot 2026-11-08.