HuatuoGPT-o1-7B: benchmark results
Provider: Other.
Aggregate Rating 1502 ± 25, rank #2314 of 10916 rated models, from 32 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| ClinicalMC (English) | 47.77 | Mean of 11 task scores (%; triage accuracy, examination reca | 90 |
| ClinicalMC (Chinese) | 43.4 | Mean of 11 task scores (%; triage accuracy, examination reca | 76.2 |
| PsychEthicsBench - Ethical Behavior | 70.71 | Overall ethical rate (%; share of 2,612 open-ended answers t | 75 |
| MR-Bench - Procedure Selection | 59.9 | Accuracy (%, times 100) at picking the admission's procedure | 73.9 |
| PsychEthicsBench - Ethical Knowledge | 70.44 | Exact match (%; 1,377 single- and multiple-answer questions | 66.7 |
| SurgiQ - Robotic Surgery | 60.99 | Robotic surgery questions (1,643): accuracy (%) on SurgiQ's | 61.8 |
| MR-Bench | 41 | Accuracy (%, times 100), mean of the medication-imputation a | 60.9 |
| SurgiQ | 57.92 | Micro accuracy over all 13,055 questions: accuracy (%) on Su | 58.8 |
| SurgiQ - Case-Based | 58.27 | Case-based questions (6,156): accuracy (%) on SurgiQ's four- | 58.8 |
| SurgiQ - General Surgery | 58.75 | General surgery questions (6,948): accuracy (%) on SurgiQ's | 58.8 |
| SurgiQ - Negative | 57.67 | Negative (all-except) questions (2,153): accuracy (%) on Sur | 55.9 |
| SurgiQ - Neurosurgery | 58.03 | Neurosurgery questions (2,204): accuracy (%) on SurgiQ's fou | 52.9 |
Interactive version: theaggregate.ai/model?slug=huatuogpt-o1-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.