NICE - Sociocultural Intelligence: leaderboard

Metric: Ranking accuracy (%) on the sociocultural intelligence dimension on NICE (137 human-written items in Chinese social contexts, each a ranking of an optimal, a suboptimal and a boundary-violating response), an item counts only when the full ranking matches the gold order, first-party APIs at temperature 0, three runs pooled; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)75
2GPT-5.575
3Qwen 3.6 Plus66.7
4DeepSeek V4 Pro61.1
5Claude Opus 4.758.3

Interactive version: theaggregate.ai/benchmark?slug=nice-sociocultural-intelligence · How It Works · Data refreshed daily, snapshot 2026-10-07.