LoSoNA - Style Adaptation: leaderboard

LoSoNA (2026) tests local social norm adaptation: in 38 curated group chats other participants demonstrate an unstated local norm, and a final turn forces a reply that shows whether the model inferred it, judged by an LLM. This board is accuracy at 3 (%) when the model is softly told to fit the local context, tone and habits; higher is better.

Metric: Accuracy@3 (%) under the style-adaptation (fit the local context, tone and habits, without naming norms) prompt condition on 38 curated group-chat scenarios in which other participants demonstrate a hidden local norm and a final elicitor turn forces a revealing reply; three sampled replies per scenario judged for compliance by a fixed Gemini 3.1 Pro Preview judge; accuracy@3 (%) is the share of scenarios where the majority of the three replies comply; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 8 models tracked. Updated 30 Sep 2026.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)47.4#93
2Claude Fable 544.7#27
3Claude Opus 4.834.2#58
4Mistral Medium 3.134.2#863
5Llama 3.3 70B Instruct28.9#1379
6GPT-5.526.3#52
7Gemma 3 27B (IT)21.1#1322
8Qwen 2.5 72B Instruct21.1#1095

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=losona-style-adaptation · How It Works · Data refreshed daily, snapshot 2026-11-16.