Vicuna-33B-1-3-SuperHOT-8K-fp16: benchmark results
Provider: LMSYS.
Aggregate Rating 1125 ± 18, rank #10436 of 10916 rated models, from 62 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - TruthfulQA MC2 | 46.93 | Accuracy (%) | 59.1 |
| MMLU-by-task - Machine Learning | 30.36 | Accuracy (%) | 39 |
| MMLU-by-task - College Physics | 22.55 | Accuracy (%) | 34.3 |
| MMLU-by-task - Business Ethics | 34 | Accuracy (%) | 33.2 |
| MMLU-by-task - High School European History | 27.27 | Accuracy (%) | 27.3 |
| MMLU-by-task - Econometrics | 25.44 | Accuracy (%) | 26.9 |
| MMLU-by-task - High School Biology | 28.39 | Accuracy (%) | 26.5 |
| MMLU-by-task - Medical Genetics | 30 | Accuracy (%) | 25.6 |
| MMLU-by-task - Computer Security | 30 | Accuracy (%) | 25.1 |
| MMLU-by-task - High School Statistics | 26.39 | Accuracy (%) | 22.6 |
| MMLU-by-task - Jurisprudence | 26.85 | Accuracy (%) | 22.3 |
| MMLU-by-task - High School World History | 27 | Accuracy (%) | 21.6 |
Interactive version: theaggregate.ai/model?slug=vicuna-33b-1-3-superhot-8k-fp16 · How It Works · Data refreshed daily, snapshot 2026-11-08.