Llama 4 Maverick Instruct FP8: benchmark results

Llama 4 Maverick Instruct evaluated in FP8 quantization. Provider: Meta. Released 2025-04-05. Access: Open.

Aggregate Rating 1607 ± 8, rank #414 of 1656 rated models, from 926 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HELM SeaHELM - Flores (en-ta)51.98ChrF++100
HELM SeaHELM - Flores (th-en)59.27ChrF++100
HELM SeaHELM - XQuAD (Thai)77.14SQuAD macro-averaged F1 score100
HELM VHELM - Mmmu - Sociology86.67Prefix Quasi-Exact Match (%)100
Twinkle Eval - TW-Legal Benchmark v161.4Accuracy (%)100
Nejumi 4 - BFCL - Relevance Detection100Accuracy (%)98.6
HELM VHELM - Blink Perception84.43PEM97.9
HELM VHELM - Mm Star Perception - Fine-grained Perception70.4Prefix Quasi-Exact Match (%)97.9
FilBench - Cultural Knowledge76.75Category Score (%)97.3
FilBench67.67FilBench Score (%)97.2
TableVista - Partial52.9Accuracy (%) on the 3,000 TableVista questions under the Par96.4
Twinkle Eval - TMMLU+78.38Accuracy (%)96.4

Interactive version: theaggregate.ai/model?slug=llama-4-maverick-instruct-fp8 · How It Works · Data refreshed daily, snapshot 2026-10-20.