Llama 3.1 70B Instruct [4bit]: benchmark results

Provider: Meta.

Aggregate Rating 1553 ± 50, rank #1666 of 10916 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Portuguese LLM - FaQuAD NLI81.69Macro F1 (%)92.9
Open Portuguese LLM - BLUEX70.65Accuracy (%)92.2
Open Portuguese LLM - OAB Exams58.91Accuracy (%)91.6
Open Portuguese LLM - ENEM74.74Accuracy (%)87.3
Open Portuguese LLM - ASSIN2 RTE92.64Macro F1 (%)81.4
Czech Opinion ABSA (10-Shot) - ASQP40.99Micro F1 (%) of exact-match aspect sentiment quad (aspect te77.8
Czech Opinion ABSA (10-Shot) - ACOS33.37Micro F1 (%) of exact-match aspect-category-opinion-sentimen66.7
Czech Opinion ABSA (Zero-Shot) - ASQP31.86Micro F1 (%) of exact-match aspect sentiment quad (aspect te66.7
Czech Opinion ABSA (10-Shot)40.86Mean of the ASTE, ASQP and ACOS micro F1 scores (%) on the C55.6
Czech Opinion ABSA (10-Shot) - ASTE48.23Micro F1 (%) of exact-match aspect sentiment triplet (aspect55.6
Czech Opinion ABSA (Zero-Shot)34.76Mean of the ASTE, ASQP and ACOS micro F1 scores (%) on the C55.6
Czech Opinion ABSA (Zero-Shot) - ACOS26.49Micro F1 (%) of exact-match aspect-category-opinion-sentimen55.6

Interactive version: theaggregate.ai/model?slug=llama-3-1-70b-instruct-4bit · How It Works · Data refreshed daily, snapshot 2026-11-08.