Intern-S1-Pro: benchmark results

Provider: Shanghai AI Lab. Access: Open.

Aggregate Rating 1654 ± 23, rank #598 of 10916 rated models, from 30 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SciHazard (Science-Specific Models)0.88DeHarm-Score (0-5, lower is safer; the mean over 2,400 hazar100
LithoBench93.38MCQ$_{\mathrm{all}}$ (self-reported)80
LithoBench - Identification and Description (Open-Ended)3.23OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1080
LithoBench - Practical Application (Open-Ended)3.91OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1080
LiveSecBench63.63Overall Score (%)73.8
LithoBench - Comprehensive Reasoning (Open-Ended)4.42OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1070
LithoBench - Open-Ended3.88OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1070
OmniMatBench - Calculation23.2Calculation strict exact-slot accuracy (%): share of structu66.7
LithoBench - Identification and Description (MCQ)70.38Accuracy (%) on the 800 multiple-choice identification-and-d63.6
LithoBench - Comparative Analysis (Open-Ended)3.73OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1060
LithoBench - Mechanism Explanation (Open-Ended)4.1OPEN_J score (0-10) = 0.4 x ROUGE-L x 10 + 0.2 x BLEU-4 x 1060
UAV-DualCog - Self-Relative Position29.4Answer accuracy (%; 1,024 questions asking where the UAV is 51.4

Interactive version: theaggregate.ai/model?slug=intern-s1-pro · How It Works · Data refreshed daily, snapshot 2026-11-08.