Llama-3-Refueled [bfloat16] [rev: ff6d1c3ba37B]: benchmark results

Provider: Meta. Access: Open.

Aggregate Rating 1403 ± 37, rank #5930 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU64.69Accuracy (%) (5-shot)75
Open LLM Leaderboard v1 - GSM8K61.64Accuracy (%) (5-shot)74.4
Open LLM Leaderboard v1 - WinoGrande79.95Accuracy (%) (5-shot)71.6
Open LLM Leaderboard v1 - HellaSwag79.09Normalized accuracy (%) (10-shot)36.7
Open LLM Leaderboard v1 - ARC Challenge54.69Normalized accuracy (%) (25-shot)31.9
Open LLM Leaderboard v1 - TruthfulQA MC241.73MC2 (%) (0-shot)18

Interactive version: theaggregate.ai/model?slug=llama-3-refueled-bfloat16-rev-ff6d1c3ba37b · How It Works · Data refreshed daily, snapshot 2026-11-08.