Meerkat-8B: benchmark results
Provider: Other.
Aggregate Rating 1522 ± 33, rank #2048 of 10916 rated models, from 15 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MedPRMBench (Step Probability) | 55.3 | PRMScore (%): mean of the F1 for erroneous steps and the F1 | 72.7 |
| SurgiQ - Critical Care and Emergency | 58.98 | Critical care and emergency surgery questions (590): accurac | 55.9 |
| SurgiQ - Orthopedic Surgery | 52.99 | Orthopedic surgery questions (1,189): accuracy (%) on SurgiQ | 54.4 |
| SurgiQ - General Surgery | 56.72 | General surgery questions (6,948): accuracy (%) on SurgiQ's | 50 |
| SurgiQ - Negative | 55.76 | Negative (all-except) questions (2,153): accuracy (%) on Sur | 50 |
| SurgiQ | 56.09 | Micro accuracy over all 13,055 questions: accuracy (%) on Su | 47.1 |
| SurgiQ - Case-Based | 56.05 | Case-based questions (6,156): accuracy (%) on SurgiQ's four- | 47.1 |
| SurgiQ - Reasoning | 57.92 | Reasoning questions (2,673): accuracy (%) on SurgiQ's four-o | 44.1 |
| SurgiQ - Best-Option | 54.1 | Best-option questions (2,085), several options partly correc | 41.2 |
| SurgiQ - Neurosurgery | 55.99 | Neurosurgery questions (2,204): accuracy (%) on SurgiQ's fou | 41.2 |
| SurgiQ - Robotic Surgery | 55.57 | Robotic surgery questions (1,643): accuracy (%) on SurgiQ's | 41.2 |
| SurgiQ - Laparoscopic Surgery | 54.16 | Laparoscopic surgery questions (493): accuracy (%) on SurgiQ | 38.2 |
Interactive version: theaggregate.ai/model?slug=meerkat-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.