Open Medical-LLM Leaderboard (BenchmarkList): leaderboard

BenchmarkList imports the medical question-answering average over PubMedQA, MedQA, MedMCQA and six medical MMLU subjects. Some imported model labels lack the precision, repository namespace or checkpoint revision retained by the primary leaderboard. This cohort preserves the imported scores without merging those ambiguous identities into the primary results.

Metric: Medical average (%). Source: benchmarklist.com. Saturation forecast: Estimated already saturated. 185 models tracked.

Top models

#ModelScoreOverall rank
1GPT-482.97#448
2Daredevil-8B-abliterated-dpomix70.99#843
3Daredevil-8B-abliterated70.86#855
4Llama 3 8B Slerp Biomed Chat Chinese70.78#1211
5NeuralLLaMa-3-8B-DT-v0.170.43#926
6NeuralLLaMa-3-8B-ORPO-v0.370.4#1149
7llama-3-merged-linear70.13#887
8Llama 3 8B Ita70.11#929
9ChimeraLlama-3-8B-v370.05#1059
10Barcenas-Llama3-8B-ORPO69.93#952
11Llama 3 8B69.9#1244
12Llama-3-SauerkrautLM-8B-Instruct69.76#896
13bagel-8B-v1.069.66#1040
14Llama-3-8B-Instruct-abliterated-dpomix69.65#1045
15suzume-llama-3-8B-multilingual69.3#1088

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-medical-llm-leaderboard-benchmarklist · How It Works · Data refreshed daily, snapshot 2026-10-24.