JANUS - Ordering: leaderboard
Metric: Ordering distortion, signed from -1 to 1: change in one minus the adverse-first rate over expressed favorable and adverse fact pairs, paired distortion: the aspect score of the goal-conditioned response minus that of the neutral response for the same JANUS scenario (six true facts, three favorable and three adverse to an institutional objective, shown in the same order in both conditions), averaged over scenarios; facts are matched to sentences and framing is labelled by a Qwen3-8B judge with thinking disabled; zero-shot at provider or checkpoint default decoding; lower is better. Source: arxiv.org. Saturation forecast: Around 2032. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.4 Mini | 0.04 |
| 2 | Qwen 3 32B | 0.05 |
| 3 | Qwen 3 8B (Non-reasoning) | 0.05 |
| 4 | GPT-5.4 | 0.05 |
| 5 | Qwen 3 14B | 0.07 |
| 6 | Llama 3.1 8B Instruct | 0.08 |
| 7 | Qwen 3 32B (Non-reasoning) | 0.08 |
| 8 | Qwen 3 8B | 0.09 |
| 9 | DeepSeek V4 Flash (Non-reasoning) | 0.1 |
| 10 | Qwen 3 14B (Non-reasoning) | 0.1 |
Interactive version: theaggregate.ai/benchmark?slug=janus-ordering · How It Works · Data refreshed daily, snapshot 2026-09-29.