Llama-3.3-Swallow-70B-Instruct-v0.4: benchmark results

Provider: Meta. Access: Open.

Unified ELO 1539 ± 1, rank #487 of 1392 rated models, from 80 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Japanese LLM - Jcommonsenseqa Exact Match97.86Score (%)100
Open Japanese LLM - AIO Char F189.25Score (%)99.5
Open Japanese LLM - ALT E TO J Comet Wmt2291.61Score (%)98.3
Open Japanese LLM - Niilc Char F167.39Score (%)97.8
Open Japanese LLM - MT85.99Score (%)97.6
Open Japanese LLM - ALT J TO E Comet Wmt2289.23Score (%)97.5
Open Japanese LLM - QA72.74Score (%)97.1
Open Japanese LLM - ALT E TO J Bleu JA14.94Score (%)97
Open Japanese LLM - Wikicorpus J TO E Comet Wmt2277.15Score (%)96.9
Open Japanese LLM - Wikicorpus E TO J Comet Wmt2285.96Score (%)96.6
Open Japanese LLM - ALT E TO J Bert Score JA F187.44Score (%)96.2
Open Japanese LLM - Wiki PAS SET F111.64Score (%)96

Interactive version: theaggregate.ai/model?slug=llama-3-3-swallow-70b-instruct-v0-4 · How It Works · Data refreshed daily, snapshot 2026-09-05.