bertin-gpt-j-6B-alpaca: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1140 ± 16, rank #10122 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Physics26.47Accuracy (%)57.9
MMLU-by-task - High School Statistics39.81Accuracy (%)54.3
MMLU-by-task - College Chemistry32Accuracy (%)46.9
MMLU-by-task - TruthfulQA MC127.54Accuracy (%)46.5
MMLU-by-task - TruthfulQA MC243.38Accuracy (%)42.6
MMLU-by-task - College Medicine33.53Accuracy (%)39.3
MMLU-by-task - Security Studies39.18Accuracy (%)37.2
MMLU-by-task - College Computer Science33Accuracy (%)36.5
MMLU-by-task - Medical Genetics38Accuracy (%)36.2
MMLU-by-task - Clinical Knowledge32.83Accuracy (%)34.1
MMLU-by-task - Astronomy31.58Accuracy (%)33.7
MMLU-by-task - Professional Medicine40.07Accuracy (%)33.4

Interactive version: theaggregate.ai/model?slug=bertin-gpt-j-6b-alpaca · How It Works · Data refreshed daily, snapshot 2026-11-08.