Llama 3 8B Instruct 262k: benchmark results

Provider: Meta. Released 2024-04-18. Access: Open.

Aggregate Rating 1431 ± 36, rank #4779 of 10516 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Medical LLM - MedMCQA57.4Accuracy (%)81
Open Medical LLM - MMLU Medical Genetics81Accuracy (%)70.8
Open Portuguese LLM - OAB Exams46.74Accuracy (%)64.3
Open Medical LLM - MMLU Anatomy63.7Accuracy (%)61.5
Open Medical-LLM Leaderboard (BenchmarkList)67.67Medical average (%)57.8
Open Medical LLM67.67Average Accuracy (%)57.3
Open Medical LLM - MedQA (USMLE)57.11Accuracy (%)54.2
Open Medical LLM - MMLU College Biology75Accuracy (%)53.9
Open Medical LLM - MMLU Professional Medicine70.22Accuracy (%)51.8
Open Portuguese LLM - ENEM61.58Accuracy (%)49.8
Open Portuguese LLM - BLUEX50.76Accuracy (%)48.1
Open Medical LLM - MMLU Clinical Knowledge70.57Accuracy (%)46.9

Interactive version: theaggregate.ai/model?slug=llama-3-8b-instruct-262k · How It Works · Data refreshed daily, snapshot 2026-11-21.