h2ogpt-gm-oasst1-multilang-1024-20B: benchmark results

Provider: H2O.ai. Access: Open.

Aggregate Rating 1152 ± 16, rank #9948 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - College Physics34.31Accuracy (%)86.4
MMLU-by-task - High School Physics32.45Accuracy (%)66
MMLU-by-task - Moral Scenarios24.8Accuracy (%)41.6
MMLU-by-task - ARC Challenge43.69Accuracy (%)39
MMLU-by-task - HellaSwag53.5Accuracy (%)36.7
MMLU-by-task - High School US History31.37Accuracy (%)35.1
MMLU-by-task - World Religions34.5Accuracy (%)33.2
MMLU-by-task - Electrical Engineering30.34Accuracy (%)32.9
MMLU-by-task - Moral Disputes30.35Accuracy (%)32.5
MMLU-by-task - Astronomy30.92Accuracy (%)32.4
MMLU-by-task - Computer Security35Accuracy (%)32.3
MMLU-by-task - High School World History29.96Accuracy (%)31.6

Interactive version: theaggregate.ai/model?slug=h2ogpt-gm-oasst1-multilang-1024-20b · How It Works · Data refreshed daily, snapshot 2026-11-08.