Llama 4 Scout Instruct: benchmark results

Meta's smaller natively multimodal Llama 4 MoE (109B total/17B active, 16 experts) with a 10M-token context (April 2025). Provider: Meta. Released 2025-04-05. Access: Open.

Aggregate Rating 1571 ± 6, rank #539 of 1656 rated models, from 1518 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BehaviorBench (Behavioral Traces) - Trade Amount Error (ProfileGen)10.3Median absolute error of the predicted trade amount (paper u100
GSM-Plus-BN - Adding Operation74.55Accuracy (%; adding operation perturbation, an extra arithme100
GSM-Plus-BN - Integer-Decimal-Fraction Conversion (CoT)79.52Accuracy (%; integer-decimal-fraction conversion perturbatio100
GSM-Plus-BN - Numerical Substitution85.23Accuracy (%; numerical substitution perturbation, numbers re100
GSM-Plus-BN - Numerical Substitution (CoT)88.42Accuracy (%; numerical substitution perturbation, numbers re100
GSM-Plus-BN - Reversing Operation (CoT)88Accuracy (%; reversing operation perturbation, the result gi100
HELM Long Context - InfiniteBench En.Sum17.6ROUGE-L100
HELM VHELM - Blink Perception - Relative Depth96.77Prefix Quasi-Exact Match (%)100
HumanAgencyBench - Avoid Value Manipulation66.88HAB dimension score (0-100, o3-judged rubric)100
Open PL LLM - PolEmo2-IN (generative, 5-shot)89.34Accuracy (%)100
SEA-HELM (Tamil) - Summarization14.4Normalized Score100
SEA-HELM (Thai) - Question Answering89.1Normalized Score100

Interactive version: theaggregate.ai/model?slug=llama-4-scout-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.