smartyplats-3B-v2: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1138 ± 16, rank #10161 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Physics | 26.47 | Accuracy (%) | 57.9 |
| MMLU-by-task - Machine Learning | 33.04 | Accuracy (%) | 53.4 |
| MMLU-by-task - Formal Logic | 29.37 | Accuracy (%) | 45.8 |
| MMLU-by-task - Moral Scenarios | 24.69 | Accuracy (%) | 38.9 |
| MMLU-by-task - HellaSwag | 52.89 | Accuracy (%) | 35.7 |
| MMLU-by-task - Medical Genetics | 35 | Accuracy (%) | 34 |
| MMLU-by-task - Human Sexuality | 29.77 | Accuracy (%) | 31.9 |
| MMLU-by-task - Marketing | 32.05 | Accuracy (%) | 31.9 |
| MMLU-by-task - Business Ethics | 31 | Accuracy (%) | 29.3 |
| MMLU-by-task - ARC Challenge | 36.69 | Accuracy (%) | 27.1 |
| MMLU-by-task - US Foreign Policy | 30 | Accuracy (%) | 27 |
| MMLU-by-task - Human Aging | 33.18 | Accuracy (%) | 25.7 |
Interactive version: theaggregate.ai/model?slug=smartyplats-3b-v2 · How It Works · Data refreshed daily, snapshot 2026-11-08.