vicuna-7B-v1.5-lora-mctaco-modified2: benchmark results

Provider: LMSYS.

Aggregate Rating 1297 ± 18, rank #8777 of 10916 rated models, from 62 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Mathematics38Accuracy (%)89.5
MMLU-by-task - Machine Learning42.86Accuracy (%)85.8
MMLU-by-task - Electrical Engineering49.66Accuracy (%)73.9
MMLU-by-task - Conceptual Physics42.98Accuracy (%)68.1
MMLU-by-task - High School Chemistry39.41Accuracy (%)66.7
MMLU-by-task - College Biology54.86Accuracy (%)65.4
MMLU-by-task - Medical Genetics56Accuracy (%)65.3
MMLU-by-task - Computer Security65Accuracy (%)65
MMLU-by-task - College Computer Science43Accuracy (%)64.3
MMLU-by-task - Public Relations59.09Accuracy (%)63.1
MMLU-by-task - Business Ethics52Accuracy (%)61.8
MMLU-by-task - High School European History64.85Accuracy (%)61.8

Interactive version: theaggregate.ai/model?slug=vicuna-7b-v1-5-lora-mctaco-modified2 · How It Works · Data refreshed daily, snapshot 2026-11-08.