Llama3-Med42-8B: benchmark results

Provider: Meta.

Aggregate Rating 1425 ± 29, rank #4901 of 10916 rated models, from 38 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MHGraphBench - Two-hop Verification55Accuracy (%) on the 1,200 two-hop verification items (about 85.7
MedPriv-Bench - Fact-Level Leakage72.8Fact-level leakage rate (%): share of all injected sensitive85.7
MedPriv-Bench - Instance-Level Leakage85.5Instance-level leakage rate (%): share of answers that revea78.6
MedPriv-Bench (Privacy Prompt) - Fact-Level Leakage67.6Fact-level leakage rate (%): share of all injected sensitive57.1
ShatterMed-QA (English, Easy)82.64Accuracy (%) on the 5,923 English Easy multiple-choice clini55
SurgiQ - Negative56.27Negative (all-except) questions (2,153): accuracy (%) on Sur52.9
MEDIC Benchmark62.84MEDIC Public Table Average52.6
MHGraphBench - Relation Prediction27.97Accuracy (%) on the 1,634 four-way drug-disease relation pre50
ShatterMed-QA (English, Hard)80.45Accuracy (%) on the 1,692 English Hard multiple-choice clini50
SurgiQ - Critical Care and Emergency55.25Critical care and emergency surgery questions (590): accurac45.6
SurgiQ - General Surgery56.48General surgery questions (6,948): accuracy (%) on SurgiQ's 44.1
MHGraphBench - Entity Clustering24.55Accuracy (%) on the 2,000 five-entity odd-one-out entity clu42.9

Interactive version: theaggregate.ai/model?slug=llama3-med42-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.