HuatuoGPT-o1-70B: benchmark results

Provider: Other.

Aggregate Rating 1565 ± 25, rank #1475 of 10916 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SurgiQ65.45Micro accuracy over all 13,055 questions: accuracy (%) on Su94.1
SurgiQ - Critical Care and Emergency65.76Critical care and emergency surgery questions (590): accurac94.1
SurgiQ - General Surgery67.47General surgery questions (6,948): accuracy (%) on SurgiQ's 94.1
SurgiQ - Reasoning68.21Reasoning questions (2,673): accuracy (%) on SurgiQ's four-o94.1
CureMed-Bench - Language Consistency86.79Language consistency (%; share of final answers written in t93.8
CureMed-Bench66.67Logical accuracy (%; share of final answers a GPT-4o judge m91.7
SurgiQ - Case-Based65.71Case-based questions (6,156): accuracy (%) on SurgiQ's four-91.2
SurgiQ - Neurosurgery66.29Neurosurgery questions (2,204): accuracy (%) on SurgiQ's fou89.7
SurgiQ - Laparoscopic Surgery64.1Laparoscopic surgery questions (493): accuracy (%) on SurgiQ88.2
SurgiQ - Negative65.75Negative (all-except) questions (2,153): accuracy (%) on Sur88.2
SurgiQ - Best-Option60.87Best-option questions (2,085), several options partly correc79.4
MedPIC-Bench - Rule Activation63.4Accuracy (%)68.5

Interactive version: theaggregate.ai/model?slug=huatuogpt-o1-70b · How It Works · Data refreshed daily, snapshot 2026-11-08.