test-1400 (Devio): benchmark results
Provider: Other.
Aggregate Rating 1148 ± 21, rank #9988 of 10916 rated models, from 62 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Physics | 28.43 | Accuracy (%) | 67.4 |
| MMLU-by-task - High School Physics | 32.45 | Accuracy (%) | 66 |
| MMLU-by-task - Global Facts | 34 | Accuracy (%) | 58.4 |
| MMLU-by-task - High School Statistics | 40.74 | Accuracy (%) | 57.1 |
| MMLU-by-task - Formal Logic | 31.75 | Accuracy (%) | 56 |
| MMLU-by-task - Elementary Mathematics | 28.57 | Accuracy (%) | 49.3 |
| MMLU-by-task - Moral Scenarios | 25.36 | Accuracy (%) | 47.6 |
| MMLU-by-task - College Chemistry | 32 | Accuracy (%) | 46.9 |
| MMLU-by-task - College Mathematics | 31 | Accuracy (%) | 45.5 |
| MMLU-by-task - Astronomy | 36.84 | Accuracy (%) | 39.7 |
| MMLU-by-task - Security Studies | 40 | Accuracy (%) | 39.1 |
| MMLU-by-task - High School Macroeconomics | 36.15 | Accuracy (%) | 38.3 |
Interactive version: theaggregate.ai/model?slug=test-1400-devio · How It Works · Data refreshed daily, snapshot 2026-11-08.