DriftBench common judge aggregate opus / multi_turn_pressure - Objective Fidelity: leaderboard
DriftBench's camera-ready version is dated 2026-10-26. It uses 38 research briefs across 24 domains with 2 replications; the clean cohort has 2116 runs after 30 stray pilot Sonnet rows are removed. Single-shot runs have 1 turn, neutral/pressure runs have 6 turns, and checkpoint runs have 8 turns. Main output is capped at 4096 tokens and probe output at 1024. GPT and Sonnet use temperature 0.7; Gemini uses temperature 1. Exact Together instruct routes are retained. Opus 4.6 is the common judge for the primary study, GPT 5.4 is the common judge for robustness, and published cross-family judging remains separate. Fidelity, adherence, coverage, and complexity use a 0–4 scale. Knows But Violates (KBV) requires noncompliance (adherence < 4) and final-probe accuracy >= 0.8. Source-specific sample counts, uncapped runs, and judge identities are pinned. This intake makes no model API calls. Metric: Objective Fidelity (0-4).
Metric: Objective Fidelity (0-4). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DriftBench openai/gpt-5.4 | 4 | |
| 2 | DriftBench openai/gpt-5.4-mini | 3.96 | |
| 3 | DriftBench gemini/gemini-3.1-pro-preview | 3.92 | |
| 4 | DriftBench together_ai/Qwen/Qwen3-235B-A22B-Instruct-2507-tput | 3.69 | |
| 5 | DriftBench together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo | 3.37 | |
| 6 | DriftBench gemini/gemini-3.1-flash-lite-preview | 3.3 | |
| 7 | DriftBench anthropic/claude-sonnet-4-6 | 3.25 |
Interactive version: theaggregate.ai/benchmark?slug=driftbench-common-judge-aggregate-opus-multi-turn-pressure-objective-fidelity · How It Works · Data refreshed daily, snapshot 2026-10-28.