llama-3-cat-8B-instruct: benchmark results

Provider: Meta.

Aggregate Rating 1398 ± 34, rank #6218 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K60.58Accuracy (%) (5-shot)72.7
Open LLM Leaderboard v1 - MMLU62.99Accuracy (%) (5-shot)57.8
Open LLM Leaderboard v1 - TruthfulQA MC250.85MC2 (%) (0-shot)49.7
Open LLM Leaderboard v1 - ARC Challenge59.39Normalized accuracy (%) (25-shot)43.2
Open LLM Leaderboard v1 - WinoGrande75.61Accuracy (%) (5-shot)43.1
Open LLM Leaderboard v1 - HellaSwag79.23Normalized accuracy (%) (10-shot)37.2

Interactive version: theaggregate.ai/model?slug=llama-3-cat-8b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.