h2ogpt-gm-oasst1-en-2048-open-llama-7B-preview-300bt-v2: benchmark results

Provider: H2O.ai. Access: Open.

Aggregate Rating 1136 ± 15, rank #10197 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Global Facts33Accuracy (%)51.6
MMLU-by-task - Machine Learning32.14Accuracy (%)48.9
MMLU-by-task - Moral Scenarios24.69Accuracy (%)38.9
MMLU-by-task - TruthfulQA MC125.46Accuracy (%)35.5
MMLU-by-task - College Physics22.55Accuracy (%)34.3
MMLU-by-task - Conceptual Physics32.77Accuracy (%)33.3
MMLU-by-task - Econometrics26.32Accuracy (%)32.9
MMLU-by-task - Business Ethics33Accuracy (%)32
MMLU-by-task - Human Aging36.32Accuracy (%)31.2
MMLU-by-task - Elementary Mathematics26.19Accuracy (%)30
MMLU-by-task - High School US History27.94Accuracy (%)29.7
MMLU-by-task - Abstract Algebra26Accuracy (%)28.1

Interactive version: theaggregate.ai/model?slug=h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2 · How It Works · Data refreshed daily, snapshot 2026-11-08.