Llama 2 7B Claude Chat: benchmark results

Provider: Meta. Access: Open.

Aggregate Rating 1287 ± 15, rank #8887 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Econometrics35.96Accuracy (%)86.5
MMLU-by-task - College Mathematics35Accuracy (%)75
MMLU-by-task - Professional Medicine52.57Accuracy (%)71.4
MMLU-by-task - Conceptual Physics42.98Accuracy (%)68.1
MMLU-by-task - Machine Learning36.61Accuracy (%)68
MMLU-by-task - Business Ethics53Accuracy (%)66.1
MMLU-by-task - Philosophy60.13Accuracy (%)65
MMLU-by-task - High School Mathematics28.52Accuracy (%)64.7
MMLU-by-task - College Medicine45.09Accuracy (%)62.3
MMLU-by-task - HellaSwag60.54Accuracy (%)61.1
MMLU-by-task - World Religions71.35Accuracy (%)60.5
MMLU-by-task - Virology42.77Accuracy (%)60.3

Interactive version: theaggregate.ai/model?slug=llama-2-7b-claude-chat · How It Works · Data refreshed daily, snapshot 2026-11-08.