Llama 2 7B Chat Guanaco Freeze Embed Tokens Q V Proj: benchmark results

Provider: Meta. Access: Open.

Aggregate Rating 1298 ± 33, rank #8769 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K11.68Accuracy (%) (5-shot)33.1
Open LLM Leaderboard v1 - HellaSwag76.99Normalized accuracy (%) (10-shot)29.9
Open LLM Leaderboard v1 - MMLU47.13Accuracy (%) (5-shot)26
Open LLM Leaderboard v1 - ARC Challenge51.45Normalized accuracy (%) (25-shot)25.9
Open LLM Leaderboard v1 - WinoGrande69.22Accuracy (%) (5-shot)23.3
Open LLM Leaderboard v1 - TruthfulQA MC243.15MC2 (%) (0-shot)22.7

Interactive version: theaggregate.ai/model?slug=llama-2-7b-chat-guanaco-freeze-embed-tokens-q-v-proj · How It Works · Data refreshed daily, snapshot 2026-11-08.