instruct-12B: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1148 ± 16, rank #10000 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Abstract Algebra | 35 | Accuracy (%) | 87.4 |
| MMLU-by-task - High School Mathematics | 27.41 | Accuracy (%) | 54.7 |
| MMLU-by-task - High School Chemistry | 29.56 | Accuracy (%) | 38.5 |
| MMLU-by-task - College Mathematics | 30 | Accuracy (%) | 38.1 |
| MMLU-by-task - International Law | 45.45 | Accuracy (%) | 36.6 |
| MMLU-by-task - Anatomy | 35.56 | Accuracy (%) | 35.8 |
| MMLU-by-task - High School Geography | 36.87 | Accuracy (%) | 35.4 |
| MMLU-by-task - High School Physics | 27.81 | Accuracy (%) | 35 |
| MMLU-by-task - Professional Law | 28.16 | Accuracy (%) | 33.8 |
| MMLU-by-task - Econometrics | 26.32 | Accuracy (%) | 32.9 |
| MMLU-by-task - HellaSwag | 51.05 | Accuracy (%) | 32.8 |
| MMLU-by-task - Philosophy | 32.15 | Accuracy (%) | 32.8 |
Interactive version: theaggregate.ai/model?slug=instruct-12b · How It Works · Data refreshed daily, snapshot 2026-11-08.