Llama 3 8B Slerp Med 262k: benchmark results

Provider: Meta. Access: Open.

Aggregate Rating 1343 ± 33, rank #7886 of 10916 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Medical LLM - MedMCQA56.37Accuracy (%)66.1
Open Medical LLM - MedQA (USMLE)59.7Accuracy (%)64.8
Open Medical LLM - MMLU Anatomy62.96Accuracy (%)59.6
Open Medical LLM - PubMedQA74Accuracy (%)52.1
Open Medical-LLM Leaderboard (BenchmarkList)65.56Medical average (%)48.9
Open Medical LLM65.56Average Accuracy (%)48.4
Open LLM Leaderboard v1 - GSM8K27.14Accuracy (%) (5-shot)45.1
Open Medical LLM - MMLU Medical Genetics73Accuracy (%)44
Open Medical LLM - MMLU Professional Medicine68.01Accuracy (%)42.2
Open LLM Leaderboard v1 - MMLU56Accuracy (%) (5-shot)37.9
Open Medical LLM - MMLU College Biology70.83Accuracy (%)36.2
Open Medical LLM - MMLU Clinical Knowledge66.79Accuracy (%)33.3

Interactive version: theaggregate.ai/model?slug=llama-3-8b-slerp-med-262k · How It Works · Data refreshed daily, snapshot 2026-11-08.