Llama 3 8B Ultra Instruct [bfloat16] [rev: 86da0c95da55]: benchmark results

Provider: Meta.

Aggregate Rating 1435 ± 34, rank #4433 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU68.25Accuracy (%) (5-shot)91
Open LLM Leaderboard v1 - GSM8K69.67Accuracy (%) (5-shot)90
Open LLM Leaderboard v1 - ARC Challenge64.51Normalized accuracy (%) (25-shot)66.8
Open LLM Leaderboard v1 - TruthfulQA MC252.85MC2 (%) (0-shot)57.7
Open LLM Leaderboard v1 - WinoGrande76.56Accuracy (%) (5-shot)49
Open LLM Leaderboard v1 - HellaSwag81.61Normalized accuracy (%) (10-shot)46

Interactive version: theaggregate.ai/model?slug=llama-3-8b-ultra-instruct-bfloat16-rev-86da0c95da55 · How It Works · Data refreshed daily, snapshot 2026-11-08.