vicuna-7B-delta-v1.1: benchmark results
Provider: LMSYS. Access: Open.
Aggregate Rating 1148 ± 23, rank #10002 of 10916 rated models, from 68 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - TruthfulQA MC2 | 48.61 | Accuracy (%) | 68.6 |
| MMLU-by-task - TruthfulQA MC1 | 29.5 | Accuracy (%) | 55.4 |
| MMLU-by-task - Machine Learning | 31.25 | Accuracy (%) | 43.7 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 48.95 | MC2 (%) (0-shot) | 43.2 |
| MMLU-by-task - Formal Logic | 28.57 | Accuracy (%) | 41.7 |
| Open LLM Leaderboard v1 - HellaSwag | 77.5 | Normalized accuracy (%) (10-shot) | 31 |
| Open LLM Leaderboard v1 - ARC Challenge | 53.67 | Normalized accuracy (%) (25-shot) | 29.9 |
| MMLU-by-task - World Religions | 32.16 | Accuracy (%) | 28 |
| MMLU-by-task - Business Ethics | 30 | Accuracy (%) | 26.7 |
| MMLU-by-task - Marketing | 29.06 | Accuracy (%) | 26.1 |
| MMLU-by-task - College Physics | 21.57 | Accuracy (%) | 25.7 |
| MMLU-by-task - Medical Genetics | 30 | Accuracy (%) | 25.6 |
Interactive version: theaggregate.ai/model?slug=vicuna-7b-delta-v1-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.