Llama-3-8B-Instruct-abliterated-v2: benchmark results
Provider: Meta. Released 2024-06-01. Access: Open.
Unified ELO 1419 ± 1, rank #1071 of 1392 rated models, from 25 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Medical LLM - MMLU College Biology | 79.17 | Accuracy (%) | 80.7 |
| Open Medical LLM - MedQA (USMLE) | 60.96 | Accuracy (%) | 80.1 |
| Open Korean LLM Leaderboard | 39.68 | Average Score (%) | 69.8 |
| Open Medical LLM - MMLU Medical Genetics | 80 | Accuracy (%) | 67 |
| Open Medical LLM - MedMCQA | 56.32 | Accuracy (%) | 65.9 |
| Open Medical LLM - MMLU Anatomy | 64.44 | Accuracy (%) | 65.1 |
| Open Medical LLM | 68.05 | Average Accuracy (%) | 60.2 |
| Open Medical LLM - MMLU Professional Medicine | 70.59 | Accuracy (%) | 56.2 |
| Open Medical LLM - MMLU Clinical Knowledge | 71.32 | Accuracy (%) | 52.8 |
| Open CoT - LSAT Logical Reasoning | 10.2 | CoT Gain (%) | 49.2 |
| Open Chinese LLM - GSM8K | 44.96 | Accuracy (%) | 47 |
| Open Chinese LLM - CMMLU | 53.03 | Accuracy (%) | 46.6 |
Interactive version: theaggregate.ai/model?slug=llama-3-8b-instruct-abliterated-v2 · How It Works · Data refreshed daily, snapshot 2026-09-05.