SPADE Zero Shot - RAID Abstracts AUROC: leaderboard
The SPADE paper compares six zero-shot AI-text detectors using three released language-model backbones. AUROC and true-positive rate at 5% false positives remain separate. Paired base/instruct checkpoints are retained for Binoculars and Fast-DetectGPT. Learned soft prompts and supervised detector weights are distinct artifacts. This board reports aUROC (%). Higher is better.
Metric: AUROC (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 18 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | SPADE Binoculars: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 92.9 | |
| 2 | falcon-7B (Harness: SPADE zero-shot NTS) | 92.4 | ||
| 3 | SPADE Fast-DetectGPT: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 91.1 | |
| 4 | SPADE Binoculars: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 90.2 | |
| 5 | Llama 3.1 8B (Harness: SPADE Zero Shot NTS) | 89.2 | ||
| 6 | SPADE Fast-DetectGPT: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 87.6 | |
| 7 | falcon-7B (Harness: SPADE zero-shot DNA-GPT) | 82.2 | ||
| 8 | SPADE Binoculars: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 80.7 | |
| 9 | SPADE Fast-DetectGPT: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 76.6 | |
| 10 | Qwen3-8B-Base (Harness: SPADE zero-shot NTS) | 76.3 | ||
| 11 | Qwen3-8B-Base (Harness: SPADE zero-shot Likelihood) | 75.5 | ||
| 12 | Llama 3.1 8B (Harness: SPADE Zero Shot Likelihood) | 73.7 | ||
| 13 | Llama 3.1 8B (Harness: SPADE Zero Shot DNA GPT) | 73.1 | ||
| 14 | falcon-7B (Harness: SPADE zero-shot Likelihood) | 72.2 | ||
| 15 | Qwen3-8B-Base (Harness: SPADE zero-shot DNA-GPT) | 71 |
Interactive version: theaggregate.ai/benchmark?slug=spade-zero-shot-raid-abstracts-auroc · How It Works · Data refreshed daily, snapshot 2026-11-16.