Collaiborator-MEDLLM-Llama-3-8B-v1: benchmark results
Provider: Other. Released 2024-06-01. Access: Open.
Unified ELO 1479 ± 14, rank #1465 of 2928 rated models, from 17 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - MMLU | 65.95 | Accuracy (%) (5-shot) | 85.5 |
| Open LLM Leaderboard v1 - GSM8K | 63.53 | Accuracy (%) (5-shot) | 77 |
| Open Medical LLM - MedQA (USMLE) | 59.62 | Accuracy (%) | 64.8 |
| Open Medical LLM - MedMCQA | 55.99 | Accuracy (%) | 63.6 |
| Open Medical LLM - MMLU Clinical Knowledge | 72.45 | Accuracy (%) | 62.5 |
| Open Medical LLM - MMLU College Biology | 75.69 | Accuracy (%) | 59.1 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 52.91 | MC2 (%) (0-shot) | 57.9 |
| Open Medical LLM - MMLU Anatomy | 60.74 | Accuracy (%) | 52.6 |
| Open Medical LLM | 66.67 | Average Accuracy (%) | 51.7 |
| Open Medical-LLM Leaderboard | 66.67 | Medical average (%) | 50.6 |
| Open Medical LLM - MMLU Professional Medicine | 69.49 | Accuracy (%) | 49.7 |
| Open LLM Leaderboard v1 - WinoGrande | 76.64 | Accuracy (%) (5-shot) | 49.6 |
Interactive version: theaggregate.ai/model?slug=collaiborator-medllm-llama-3-8b-v1 · How It Works · Data refreshed daily, snapshot 2026-09-23.