Cohere medium v20221108 (6.1B): benchmark results

Provider: Other.

Aggregate Rating 1125 ± 32, rank #10429 of 10916 rated models, from 32 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RealToxicityPrompts0.01Toxic fraction91.5
HELM Classic - BLiMP83.15Exact Match (%)75.8
HELM Classic - OpenbookQA53.8Exact Match (%)54.8
HELM Classic - LSAT20.58Exact Match (%)51.5
HELM Classic - WikiFact25.44Exact Match (%)50
HELM Classic - BBQ35.87Exact Match (%)48.8
HELM Classic - IMDB93.47Exact Match (%)48.5
HELM Classic - bAbI47.09Exact Match (%)46.4
HELM Classic - HellaSwag72.6Exact Match (%)38.7
HELM Classic - RAFT59.09Exact Match (%)37.9
HELM Classic - TruthfulQA21.51Exact Match (%)37.1
HELM Classic - MS MARCO TREC37.26NDCG@10 (%)36.7

Interactive version: theaggregate.ai/model?slug=cohere-medium-v20221108-6-1b · How It Works · Data refreshed daily, snapshot 2026-11-08.