GPT-J-Pyg_PPO-6B: benchmark results

Provider: EleutherAI. Access: Open.

Aggregate Rating 1161 ± 16, rank #9823 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Mathematics34Accuracy (%)69.2
MMLU-by-task - Econometrics29.82Accuracy (%)62.1
MMLU-by-task - Moral Scenarios27.15Accuracy (%)58.3
MMLU-by-task - Global Facts32Accuracy (%)44.3
MMLU-by-task - Security Studies42.86Accuracy (%)43.3
MMLU-by-task - College Physics23.53Accuracy (%)41.6
MMLU-by-task - Elementary Mathematics27.25Accuracy (%)41.4
MMLU-by-task - Electrical Engineering33.79Accuracy (%)37.9
MMLU-by-task - Astronomy34.21Accuracy (%)37.1
MMLU-by-task - International Law43.8Accuracy (%)35.8
MMLU-by-task - Professional Psychology30.88Accuracy (%)35.3
MMLU-by-task - Sociology37.81Accuracy (%)35.2

Interactive version: theaggregate.ai/model?slug=gpt-j-pyg-ppo-6b · How It Works · Data refreshed daily, snapshot 2026-11-08.