PACT - Default Compliance: leaderboard

PACT enterprise rule compliance under pressure, using three repeated trials at temperature 1. PACTScore weights initial compliance 0.75 and follow-up compliance 0.25; six diagnostic axes remain separate. Explicit instruct variants are marked as such and Inkling is included.

Metric: Score (0-1). Source: arxiv.org. Saturation forecast: Estimated already saturated. 22 models tracked.

Top models

#ModelScoreOverall rank
1Claude Haiku 4.51#287
2Qwen 3.6 27B0.99#182
3GPT-5.6 Luna0.98#79
4GLM-5.20.97#80
5Nemotron 3 Ultra0.97#245
6MiniMax-M2.50.97#316
7Kimi K2.60.96#113
8Gemini 3 Flash0.96#103
9Qwen 3.5 35B A3B0.96#268
10Kimi K2.7 Code0.96#95
11GLM-50.95#149
12Inkling0.95#144
13GPT-OSS-120B0.94#346
14Llama 3.3 70B Instruct0.94#541
15GLM-4.70.94#202

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=pact-default-compliance · How It Works · Data refreshed daily, snapshot 2026-11-05.