GPT-OSS-120B: benchmark results

OpenAI's open-weight GPT-OSS 120B, an Apache-2.0 sparse MoE (~5B active) reasoning model (August 2025). Provider: OpenAI. Released 2025-08-05. Access: Open.

Aggregate Rating 1636 ± 3, rank #341 of 1656 rated models, from 2897 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AgentJudgeBench (Hard, With Ground Truth) - SmolLM3-3B Outputs77.8Judge alignment (%; agreement of the judge's per-metric verd100
Bengali Dialect QA Consistency - Mymensingh9.22Dialect consistency score (0-10): a Gemini 2.5 Flash judge (100
BhashaBench - Finance71.05Accuracy (%)100
BhashaBench - Finance - English74.11Accuracy (%)100
BhashaBench - Finance - Hindi64.16Accuracy (%)100
CelloAI-Doc-Bench - Expert Similarity60.2Mean embedding cosine similarity (-1 to 1, times 100) betwee100
CelloAI-Doc-Bench - Tag Coverage F195.2Tag-level F1 (0-1, times 100) of the @param and @return tags100
DTap-Bench (Direct Attacks) - Browser10Attack success rate (%; 85 direct red-teaming web browser ta100
DTap-Bench (Indirect Attacks) - CRM9.3Attack success rate (%; 150 indirect red-teaming customer re100
DTap-Bench (Indirect Attacks) - Customer Service21.4Attack success rate (%; 101 indirect red-teaming customer se100
DTap-Bench (Indirect Attacks) - Workflow7.2Attack success rate (%; 107 indirect red-teaming workflow (e100
ESF-Bench - Long and Multi-Value81.5Tagged slot accuracy (%; slots tagged with a LMV (Long and M100

Interactive version: theaggregate.ai/model?slug=gpt-oss-120b · How It Works · Data refreshed daily, snapshot 2026-10-20.