palmyra-med-20B: benchmark results
Provider: Writer. Released 2023-09-01. Access: API.
Aggregate Rating 1264 ± 15, rank #9132 of 10916 rated models, from 79 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Machine Learning | 41.96 | Accuracy (%) | 84.6 |
| MMLU-by-task - Econometrics | 34.21 | Accuracy (%) | 82.6 |
| Open Medical LLM - PubMedQA | 76 | Accuracy (%) | 80.7 |
| MMLU-by-task - Medical Genetics | 58 | Accuracy (%) | 71.9 |
| MMLU-by-task - Professional Medicine | 52.57 | Accuracy (%) | 71.4 |
| MMLU-by-task - College Physics | 27.45 | Accuracy (%) | 63 |
| MMLU-by-task - College Computer Science | 42 | Accuracy (%) | 61.2 |
| MMLU-by-task - Virology | 42.77 | Accuracy (%) | 60.3 |
| MMLU-by-task - Clinical Knowledge | 53.21 | Accuracy (%) | 60.2 |
| MMLU-by-task - Nutrition | 53.92 | Accuracy (%) | 59.5 |
| MMLU-by-task - High School Mathematics | 27.78 | Accuracy (%) | 58.6 |
| MMLU-by-task - Astronomy | 47.37 | Accuracy (%) | 56.8 |
Interactive version: theaggregate.ai/model?slug=palmyra-med-20b · How It Works · Data refreshed daily, snapshot 2026-11-08.