vicuna-7B-v1.5-lora-mctaco-modified1: benchmark results

Provider: LMSYS.

Aggregate Rating 1294 ± 18, rank #8816 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Mathematics40Accuracy (%)95.3
MMLU-by-task - Conceptual Physics45.53Accuracy (%)77.1
MMLU-by-task - Medical Genetics58Accuracy (%)71.9
MMLU-by-task - Computer Security67Accuracy (%)71.5
MMLU-by-task - Elementary Mathematics32.01Accuracy (%)67.7
MMLU-by-task - College Computer Science44Accuracy (%)67.6
MMLU-by-task - Electrical Engineering47.59Accuracy (%)65.2
MMLU-by-task - Sociology68.66Accuracy (%)64
MMLU-by-task - Prehistory56.79Accuracy (%)63.3
MMLU-by-task - Public Relations59.09Accuracy (%)63.1
MMLU-by-task - Anatomy47.41Accuracy (%)61.3
MMLU-by-task - Machine Learning34.82Accuracy (%)60.8

Interactive version: theaggregate.ai/model?slug=vicuna-7b-v1-5-lora-mctaco-modified1 · How It Works · Data refreshed daily, snapshot 2026-11-08.