SafeSceneReason - Comparative Reasoning: leaderboard

Metric: Accuracy (%; the 108 comparative reasoning questions; single-answer multiple choice on the 1,000-question test set balanced across answer positions, built from workplace scene graphs and NIOSH FACE and CSB accident-report figures; temperature 0, unparseable answers counted wrong). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.

Top models

#ModelScore
1GPT-5.586.11
2GPT-5.6 Sol80.56
3Gemini 3.5 Flash78.7
4Gemini 3.1 Pro (Preview)76.85
5Kimi K2.671.3
6Claude Fable 567.59
7Qwen 3.6 27B26.85
8Qwen 3.5 9B25

Interactive version: theaggregate.ai/benchmark?slug=safescenereason-comparative-reasoning · How It Works · Data refreshed daily, snapshot 2026-09-26.