SPADE Zero Shot - RAID Poetry TPR at 5 Percent FPR: leaderboard
The SPADE paper compares six zero-shot AI-text detectors using three released language-model backbones. AUROC and true-positive rate at 5% false positives remain separate. Paired base/instruct checkpoints are retained for Binoculars and Fast-DetectGPT. Learned soft prompts and supervised detector weights are distinct artifacts. This board reports tPR at 5 Percent FPR (%). Higher is better.
Metric: TPR at 5 Percent FPR (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 18 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | SPADE Binoculars: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 77.3 | |
| 2 | falcon-7B (Harness: SPADE zero-shot NTS) | 72.7 | ||
| 3 | SPADE Binoculars: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 71.3 | |
| 4 | SPADE Fast-DetectGPT: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 66.7 | |
| 5 | SPADE Fast-DetectGPT: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 38.3 | |
| 6 | SPADE Binoculars: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 27.3 | |
| 7 | Llama 3.1 8B (Harness: SPADE Zero Shot NTS) | 23.3 | ||
| 8 | SPADE Fast-DetectGPT: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 19 | |
| 9 | falcon-7B (Harness: SPADE zero-shot DNA-GPT) | 16 | ||
| 10 | Qwen3-8B-Base (Harness: SPADE zero-shot NTS) | 15.3 | ||
| 11 | Qwen3-8B-Base (Harness: SPADE zero-shot DNA-GPT) | 10.7 | ||
| 12 | Llama 3.1 8B (Harness: SPADE Zero Shot DNA GPT) | 8 | ||
| 13 | Qwen3-8B-Base (Harness: SPADE zero-shot Likelihood) | 4 | ||
| 14 | Qwen3-8B-Base (Harness: SPADE zero-shot Entropy) | 4 | ||
| 15 | Llama 3.1 8B (Harness: SPADE Zero Shot Likelihood) | 4 |
Interactive version: theaggregate.ai/benchmark?slug=spade-zero-shot-raid-poetry-tpr-at-5-percent-fpr · How It Works · Data refreshed daily, snapshot 2026-11-16.