Myrrh_solar_10.7b_3.0: benchmark results
Provider: Other. Released 2024-02-01. Access: Open.
Unified ELO 1482 ± 16, rank #1260 of 2656 rated models, from 29 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM - KorNAT-Harmless | 88.8 | Normalized accuracy (%) | 100 |
| Open Korean LLM - KorNAT-CKA | 48.57 | Normalized accuracy (%) | 99.9 |
| Open Korean LLM - KorNAT-Helpful | 82.12 | Normalized accuracy (%) | 99.9 |
| Open Korean LLM - Ko-Winogrande | 76.09 | Accuracy (%) | 99.8 |
| Open Korean LLM - Ko-GPQA-Diamond | 29.8 | Normalized accuracy (%) | 99.7 |
| Open Chinese LLM - TruthfulQA MC | 67.81 | Accuracy (%) | 98.5 |
| Open Medical LLM - PubMedQA | 78 | Accuracy (%) | 95.5 |
| Open Korean LLM Leaderboard | 43.74 | Average Score (%) | 88.7 |
| Open Ko-LLM Leaderboard | 43.74 | Average (%) | 88.5 |
| Open Medical LLM - MMLU College Biology | 79.17 | Accuracy (%) | 80.7 |
| Open Chinese LLM - HellaSwag | 64.58 | Accuracy (%) | 76.9 |
| Open Chinese LLM - ARC Challenge | 56.06 | Accuracy (%) | 70.8 |
Interactive version: theaggregate.ai/model?slug=myrrh-solar-10-7b-3-0 · How It Works · Data refreshed daily, snapshot 2026-09-19.