Llama-3-OpenBioMed-8B-slerp-v0.3: benchmark results

Provider: Meta. Released 2024-05-01. Access: Open.

Aggregate Rating 1421 ± 33, rank #5133 of 10916 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Medical LLM - MedMCQA61.58Accuracy (%)96.9
Open Medical LLM - MMLU College Biology84.03Accuracy (%)95.3
Open Medical-LLM Leaderboard (BenchmarkList)73.56Medical average (%)93.9
Open Medical LLM73.56Average Accuracy (%)93.8
Open Medical LLM - MMLU Clinical Knowledge77.74Accuracy (%)93.8
Open Medical LLM - MMLU Anatomy71.11Accuracy (%)93
Open Medical LLM - MMLU College Medicine71.1Accuracy (%)93
Open Medical LLM - MMLU Professional Medicine79.04Accuracy (%)92.4
Open LLM Leaderboard v1 - MMLU66.55Accuracy (%) (5-shot)87.5
Open Medical LLM - MedQA (USMLE)61.27Accuracy (%)82.8
Open Medical LLM - MMLU Medical Genetics82Accuracy (%)76.6
Open LLM Leaderboard v1 - GSM8K42.46Accuracy (%) (5-shot)57.1

Interactive version: theaggregate.ai/model?slug=llama-3-openbiomed-8b-slerp-v0-3 · How It Works · Data refreshed daily, snapshot 2026-11-08.