Collaiborator-MEDLLM-Llama-3-8B-v1: benchmark results
Provider: Other. Released 2024-06-01. Access: Open.
Aggregate Rating 1413 ± 34, rank #5490 of 10916 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - MMLU | 65.95 | Accuracy (%) (5-shot) | 85.5 |
| Open LLM Leaderboard v1 - GSM8K | 63.53 | Accuracy (%) (5-shot) | 77 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 52.91 | MC2 (%) (0-shot) | 57.9 |
| Open Medical-LLM Leaderboard (BenchmarkList) | 66.67 | Medical average (%) | 50.6 |
| Open LLM Leaderboard v1 - WinoGrande | 76.64 | Accuracy (%) (5-shot) | 49.6 |
| Open LLM Leaderboard v1 - HellaSwag | 80.28 | Normalized accuracy (%) (10-shot) | 40.5 |
| Open LLM Leaderboard v1 - ARC Challenge | 58.19 | Normalized accuracy (%) (25-shot) | 39.2 |
Interactive version: theaggregate.ai/model?slug=collaiborator-medllm-llama-3-8b-v1 · How It Works · Data refreshed daily, snapshot 2026-11-08.