OPT-175B: benchmark results
Meta's OPT-175B, the 175-billion-parameter flagship of the Open Pretrained Transformer suite, matching GPT-3-class scale under a noncommercial research license requiring a manual access request. Provider: Meta. Released 2022-05-03. Access: Open.
Aggregate Rating 1256 ± 27, rank #1507 of 1635 rated models, from 43 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| HELM Classic - XSUM | 15.49 | ROUGE-2 (%) | 92.7 |
| HELM Classic - OpenbookQA | 58.6 | Exact Match (%) | 88.7 |
| HELM Classic - HellaSwag | 79.1 | Exact Match (%) | 77.4 |
| HELM Classic - LSAT | 22.03 | Exact Match (%) | 77.2 |
| HELM Classic - Synthetic Reasoning Natural | 24.79 | F1 (%) | 76.5 |
| HELM Classic - MS MARCO Regular | 28.78 | RR@10 (%) | 72.4 |
| HELM Classic - BLiMP | 83.05 | Exact Match (%) | 71 |
| HELM Classic - BoolQ | 79.3 | Exact Match (%) | 69.7 |
| HELM Classic - IMDB | 94.73 | Exact Match (%) | 68.9 |
| HELM Classic - CNN/DailyMail | 14.59 | ROUGE-2 (%) | 65.9 |
| HELM Classic - bAbI | 50.66 | Exact Match (%) | 65.2 |
| HELM | 60.95 | Mean win rate (imported) | 61.5 |
Interactive version: theaggregate.ai/model?slug=opt-175b · How It Works · Data refreshed daily, snapshot 2026-11-05.