M3-Bench - L1: leaderboard

Evaluates LLM agents' social behaviour in mixed-motive games on M3-Bench (Xie et al., 2026): 24 game-theoretic tasks across four progressive levels, each played against a fixed opponent pool with and without free-form messaging. Scores are the BTA (Behavioral Trajectory Analysis) view: rule-based indicators computed from each agent's logged actions and payoffs, normalised within the task and reported on a 0-100 scale. The scale is normative, so cooperation, fairness and joint payoff efficiency raise it and exploitation lowers it. L1 is the Level 1 average, covering basic-tension games that are two-player, full-information and one-shot, computed over all six Level 1 tasks rather than only the three shown as columns. The paper's RPA (reasoning) and CCA (communication) views are LLM-judge scores of the same episodes and are not included. This series reports M3-Bench - L1 using BTA Score.

Metric: BTA Score. Source: huggingface.co. Saturation forecast: Around March 2027. 12 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.1 (Non-reasoning)93#145 (GPT-5.1)
2GPT-5 Pro92.7#89
3Claude Opus 4.591#87
4GPT-OSS-120B87#346
5Kimi K2 (Thinking)87#252 (Kimi K2)
6DeepSeek V3.2 (Non-reasoning)86.7#210 (DeepSeek V3.2)
7Mistral Large 381.8#410

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=m3-bench-l1 · How It Works · Data refreshed daily, snapshot 2026-11-05.