Sci-Rho: leaderboard

Sci-Rho (Science Rhobustness, 2026) is a dynamic benchmark of image-grounded STEM problems in five subjects and seven languages, where each expert-written template generates ten visually and numerically varied instances. The headline is average-case accuracy (%) over all seven languages; higher is better.

Metric: Average-case accuracy (%) over all seven languages (English, Arabic, Chinese, Hindi, Indonesian, Kazakh, Swahili) on 606 expert-written executable templates per language (mathematics, physics, chemistry, biology and computer science, many drawn from olympiad problems), each rendered as 10 visually and numerically varied image-grounded instances; the mean of the per-language accuracies; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 (Non-reasoning)88.8#123 (GPT-5.4)
2Gemini 2.5 Pro85.8#266
3Qwen 3.5 27B (Non-reasoning)82.3#359 (Qwen 3.5 27B)
4Qwen 3.5 122B A10B (Non-reasoning)80.8#331 (Qwen 3.5 122B A10B)
5Gemini 2.5 Flash (Non-reasoning)80.4#453 (Gemini 2.5 Flash)
6Llama 4 Scout Instruct69.2#1543
7Qwen 3 VL 8B Instruct65.3#981
8Gemma 3 12B (IT)53.6#1837
9Molmo2-8B43.9#1483
10Gemma 3 4B (IT)36.4#3831
11Qwen 3 VL 4B Instruct26.8#1279

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sci-rho · How It Works · Data refreshed daily, snapshot 2026-11-13.