M3-Bench - AC: leaderboard
Evaluates LLM agents' social behaviour in mixed-motive games on M3-Bench (Xie et al., 2026): 24 game-theoretic tasks across four progressive levels, each played against a fixed opponent pool with and without free-form messaging. Scores are the BTA (Behavioral Trajectory Analysis) view: rule-based indicators computed from each agent's logged actions and payoffs, normalised within the task and reported on a 0-100 scale. The scale is normative, so cooperation, fairness and joint payoff efficiency raise it and exploitation lowers it. AC is the sealed-bid Auction with a collusion channel, a Level 4 game of private values and cartel incentives. The paper's RPA (reasoning) and CCA (communication) views are LLM-judge scores of the same episodes and are not included. This series reports M3-Bench - AC using BTA Score.
Metric: BTA Score. Source: huggingface.co. Saturation forecast: Around March 2027. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.1 (Non-reasoning) | 91 | #145 (GPT-5.1) |
| 2 | Claude Opus 4.5 | 87 | #87 |
| 3 | GPT-5 Pro | 86 | #89 |
| 4 | DeepSeek V3.2 (Non-reasoning) | 84 | #210 (DeepSeek V3.2) |
| 5 | GPT-OSS-120B | 79 | #346 |
| 6 | Mistral Large 3 | 74 | #410 |
| 7 | Kimi K2 (Thinking) | 73 | #252 (Kimi K2) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=m3-bench-ac · How It Works · Data refreshed daily, snapshot 2026-11-05.