vicuna-7B-v1.5: benchmark results
Provider: LMSYS. Released 2023-08-01. Access: Open.
Aggregate Rating 1302 ± 14, rank #8693 of 10916 rated models, from 91 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Mathematics | 39 | Accuracy (%) | 92.7 |
| MMLU-by-task - Machine Learning | 44.64 | Accuracy (%) | 88.2 |
| MMLU-by-task - Formal Logic | 38.1 | Accuracy (%) | 82 |
| MMLU-by-task - Anatomy | 50.37 | Accuracy (%) | 79.6 |
| MMLU-by-task - TruthfulQA MC2 | 50.34 | Accuracy (%) | 77.8 |
| MMLU-by-task - Professional Medicine | 54.04 | Accuracy (%) | 77.1 |
| MMLU-by-task - Security Studies | 62.86 | Accuracy (%) | 76.7 |
| MMLU-by-task - Human Sexuality | 63.36 | Accuracy (%) | 76.4 |
| MMLU-by-task - Conceptual Physics | 45.11 | Accuracy (%) | 75.9 |
| MMLU-by-task - TruthfulQA MC1 | 33.17 | Accuracy (%) | 71.8 |
| MMLU-by-task - Public Relations | 61.82 | Accuracy (%) | 71.4 |
| MMLU-by-task - Business Ethics | 54 | Accuracy (%) | 70.8 |
Interactive version: theaggregate.ai/model?slug=vicuna-7b-v1-5 · How It Works · Data refreshed daily, snapshot 2026-11-08.