h2ogpt-gm-oasst1-en-1024-20B: benchmark results

Provider: H2O.ai. Access: Open.

Aggregate Rating 1151 ± 16, rank #9957 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Abstract Algebra32Accuracy (%)68.1
MMLU-by-task - College Physics27.45Accuracy (%)63
MMLU-by-task - Moral Scenarios26.82Accuracy (%)56.5
MMLU-by-task - Econometrics28.95Accuracy (%)55.2
MMLU-by-task - Formal Logic29.37Accuracy (%)45.8
MMLU-by-task - ARC Challenge43.52Accuracy (%)38.7
MMLU-by-task - HellaSwag53.67Accuracy (%)37
MMLU-by-task - High School US History30.88Accuracy (%)34.6
MMLU-by-task - World Religions33.92Accuracy (%)32.5
MMLU-by-task - Prehistory30.56Accuracy (%)31.4
MMLU-by-task - Computer Security33Accuracy (%)30.6
MMLU-by-task - TruthfulQA MC124.72Accuracy (%)30.4

Interactive version: theaggregate.ai/model?slug=h2ogpt-gm-oasst1-en-1024-20b · How It Works · Data refreshed daily, snapshot 2026-11-08.