bloom-1b7: benchmark results

BigScience's BLOOM 1.7B, a multilingual transformer language model in the open BLOOM project, released under the RAIL License v1.0. Provider: BigScience. Released 2022-05-19. Access: Open.

Aggregate Rating 1143 ± 12, rank #1607 of 1635 rated models, from 85 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - High School Statistics47.22Accuracy (%)83.3
MMLU-by-task - Formal Logic35.71Accuracy (%)72.7
MMLU-by-task - High School Physics33.11Accuracy (%)70.8
MMLU-by-task - Moral Scenarios27.26Accuracy (%)59.8
MMLU-by-task - College Physics26.47Accuracy (%)57.9
MMLU-by-task - Professional Medicine44.85Accuracy (%)45.7
MMLU-by-task - College Mathematics31Accuracy (%)45.5
MMLU-by-task - Security Studies40Accuracy (%)39.1
MMLU-by-task - High School Macroeconomics35.9Accuracy (%)37.3
MMLU-by-task - Management38.83Accuracy (%)37
MMLU-by-task - Global Facts31Accuracy (%)36.8
MMLU-by-task - College Computer Science33Accuracy (%)36.5

Interactive version: theaggregate.ai/model?slug=bloom-1b7 · How It Works · Data refreshed daily, snapshot 2026-11-05.