Cosmos-Reason2-8B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1630 ± 20, rank #754 of 10916 rated models, from 121 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RepProbe Real - Exact17.5Exact (%)100
RepProbe Real - MAE2.89MAE (lower is better)100
RepProbe Real - Normalized MAE0.43Normalized MAE (lower is better)100
RepProbe Real - OBO47.5OBO (%)100
RepProbe Real - OBO Many22.2OBO Many (%)100
RepProbe Real - OBO Mid43.1OBO Mid (%)100
TAR-Bench - Multiple-Choice QA with Explanation76.2Scaled BERTScore F1 (%; a multiple-choice answer with an exp100
Physical AI Bench - Understanding Overall65.7Overall Score (%)91.7
SiT-Bench - Logic & Anomaly Detection40.22Accuracy (%; item-weighted over the category's subtasks)88.3
EgoDyn-Bench39.9Balanced accuracy (%) of semantic ego-motion questions (14 t86.7
MemLens (128K) - Temporal Reasoning43.81Accuracy (%) on the temporal reasoning (TR, 194 questions) a84.8
RepProbe Real - OBO Few62.1OBO Few (%)83.3

Interactive version: theaggregate.ai/model?slug=cosmos-reason2-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.