vicuna-7B-1.1: benchmark results
Provider: LMSYS. Access: Open.
Aggregate Rating 1281 ± 15, rank #8969 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - TruthfulQA MC1 | 33.05 | Accuracy (%) | 71.1 |
| MMLU-by-task - TruthfulQA MC2 | 48.94 | Accuracy (%) | 71 |
| MMLU-by-task - Formal Logic | 34.92 | Accuracy (%) | 69.3 |
| MMLU-by-task - College Mathematics | 34 | Accuracy (%) | 69.2 |
| MMLU-by-task - College Chemistry | 37 | Accuracy (%) | 62.4 |
| MMLU-by-task - Professional Medicine | 50.37 | Accuracy (%) | 61.3 |
| MMLU-by-task - Astronomy | 49.34 | Accuracy (%) | 60.4 |
| MMLU-by-task - Electrical Engineering | 46.21 | Accuracy (%) | 58.8 |
| MMLU-by-task - College Physics | 26.47 | Accuracy (%) | 57.9 |
| MMLU-by-task - Clinical Knowledge | 51.32 | Accuracy (%) | 57.3 |
| MMLU-by-task - Virology | 42.17 | Accuracy (%) | 56.8 |
| MMLU-by-task - Jurisprudence | 55.56 | Accuracy (%) | 55.9 |
Interactive version: theaggregate.ai/model?slug=vicuna-7b-1-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.