Llama 2 7B Chat Orcah: benchmark results

Provider: Meta.

Aggregate Rating 1296 ± 17, rank #8799 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Econometrics35.09Accuracy (%)84.6
MMLU-by-task - Global Facts37Accuracy (%)76.3
MMLU-by-task - International Law71.9Accuracy (%)72.1
MMLU-by-task - Conceptual Physics42.55Accuracy (%)65.8
MMLU-by-task - Elementary Mathematics31.75Accuracy (%)65.7
MMLU-by-task - Electrical Engineering47.59Accuracy (%)65.2
MMLU-by-task - Management67.96Accuracy (%)62.4
MMLU-by-task - College Medicine45.09Accuracy (%)62.3
MMLU-by-task - Astronomy50Accuracy (%)62.1
MMLU-by-task - High School Chemistry37.44Accuracy (%)61.3
MMLU-by-task - High School Biology56.13Accuracy (%)60.7
MMLU-by-task - Prehistory55.56Accuracy (%)60.6

Interactive version: theaggregate.ai/model?slug=llama-2-7b-chat-orcah · How It Works · Data refreshed daily, snapshot 2026-11-08.