Cosmos3-Super: benchmark results

Provider: Other.

Aggregate Rating 1776 ± 46, rank #132 of 10916 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
TAR-Bench48.8Mean score (%; unweighted mean of the ten task scores: accur100
TAR-Bench - Binary QA89.8Accuracy (%; yes/no questions about the anomaly, one positiv100
TAR-Bench - Binary QA with Explanation60Scaled BERTScore F1 (%; a yes/no answer with an explanation,100
TAR-Bench - Causal Linkage31Scaled BERTScore F1 (%; an explanation of what caused the an100
TAR-Bench - Multiple-Choice QA88.8Accuracy (%; multiple-choice questions about the anomaly; ze100
TAR-Bench - Open-Ended QA40.4Scaled BERTScore F1 (%; free-form answers compared with the 100
TAR-Bench - Scene Description28.8Scaled BERTScore F1 (%; a physical description of the scene,100
TAR-Bench - Temporal Description30.3Scaled BERTScore F1 (%; a description of what happens in a g100
TAR-Bench - Video Summarization22.4Scaled BERTScore F1 (%; a summary of the events in the clip,100
TAR-Bench - Multiple-Choice QA with Explanation71.2Scaled BERTScore F1 (%; a multiple-choice answer with an exp90
VANTAGE-Bench63.62Overall (%)82.4
VANTAGE-Bench - Spatial78.71Spatial (%)82.4

Interactive version: theaggregate.ai/model?slug=cosmos3-super · How It Works · Data refreshed daily, snapshot 2026-11-08.