Llama 2 70B IA3 Guanaco: benchmark results

Provider: Meta. Access: Open.

Aggregate Rating 1421 ± 17, rank #5137 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - International Law89.26Accuracy (%)99.9
MMLU-by-task - US Foreign Policy93Accuracy (%)99.6
MMLU-by-task - High School Mathematics35.56Accuracy (%)98.8
MMLU-by-task - Virology55.42Accuracy (%)98.8
MMLU-by-task - Jurisprudence83.33Accuracy (%)98.1
MMLU-by-task - High School Geography87.88Accuracy (%)97.8
MMLU-by-task - Medical Genetics72Accuracy (%)97.8
MMLU-by-task - Public Relations73.64Accuracy (%)97.6
MMLU-by-task - High School Biology81.94Accuracy (%)97.4
MMLU-by-task - Nutrition75.49Accuracy (%)96.5
MMLU-by-task - Astronomy80.26Accuracy (%)96.4
MMLU-by-task - High School Chemistry53.2Accuracy (%)96.4

Interactive version: theaggregate.ai/model?slug=llama-2-70b-ia3-guanaco · How It Works · Data refreshed daily, snapshot 2026-11-08.