L-MChat-7B — benchmark results
Provider: Other. Released 2024-03-01. Access: Open.
Unified ELO 1395 ± 12, rank #1250 of 1776 rated models, from 24 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Medical LLM - PubMedQA | 76.6 | Accuracy (%) | 85.2 |
| Open LLM Leaderboard - IFEval | 52.97 | Score | 62.9 |
| Open LLM Leaderboard - GPQA | 7.38 | Score | 62.2 |
| Open Medical LLM - MMLU College Biology | 74.31 | Accuracy (%) | 52.8 |
| Open Medical LLM - MMLU Anatomy | 60.74 | Accuracy (%) | 52.6 |
| Open Medical LLM - MMLU College Medicine | 62.43 | Accuracy (%) | 51.7 |
| Open Medical LLM | 65.12 | Average Accuracy (%) | 48.3 |
| Open Medical LLM - MMLU Professional Medicine | 69.12 | Accuracy (%) | 48 |
| Open Medical LLM - MedMCQA | 49.92 | Accuracy (%) | 47.7 |
| Open Chinese LLM - TruthfulQA MC | 53.26 | Accuracy (%) | 47.2 |
| Open Medical LLM - MedQA (USMLE) | 53.18 | Accuracy (%) | 46.6 |
| Open LLM Leaderboard - MMLU-Pro | 25.54 | Score | 46.1 |
Interactive version: theaggregate.ai/model?slug=l-mchat-7b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.