SPADE Zero Shot - RAID Abstracts TPR at 5 Percent FPR: leaderboard
The SPADE paper compares six zero-shot AI-text detectors using three released language-model backbones. AUROC and true-positive rate at 5% false positives remain separate. Paired base/instruct checkpoints are retained for Binoculars and Fast-DetectGPT. Learned soft prompts and supervised detector weights are distinct artifacts. This board reports tPR at 5 Percent FPR (%). Higher is better.
Metric: TPR at 5 Percent FPR (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 18 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | SPADE Binoculars: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 82.7 | |
| 2 | SPADE Fast-DetectGPT: Llama 3.1 8B + Llama 3.1 8B Instruct | Evaluation run: frozen two-checkpoint detector | 73.3 | |
| 3 | SPADE Binoculars: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 72 | |
| 4 | falcon-7B (Harness: SPADE zero-shot NTS) | 72 | ||
| 5 | Llama 3.1 8B (Harness: SPADE Zero Shot NTS) | 56 | ||
| 6 | SPADE Binoculars: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 50.7 | |
| 7 | falcon-7B (Harness: SPADE zero-shot DNA-GPT) | 50 | ||
| 8 | SPADE Fast-DetectGPT: Falcon-7B + Falcon-7B-Instruct | Evaluation run: frozen two-checkpoint detector | 42.7 | |
| 9 | Llama 3.1 8B (Harness: SPADE Zero Shot DNA GPT) | 33.3 | ||
| 10 | Qwen3-8B-Base (Harness: SPADE zero-shot NTS) | 33.3 | ||
| 11 | SPADE Fast-DetectGPT: Qwen3-8B-Base + Qwen3-8B | Evaluation run: frozen two-checkpoint detector | 32.3 | |
| 12 | Qwen3-8B-Base (Harness: SPADE zero-shot DNA-GPT) | 20.7 | ||
| 13 | Qwen3-8B-Base (Harness: SPADE zero-shot Likelihood) | 10 | ||
| 14 | Qwen3-8B-Base (Harness: SPADE zero-shot Entropy) | 10 | ||
| 15 | Llama 3.1 8B (Harness: SPADE Zero Shot Likelihood) | 10 |
Interactive version: theaggregate.ai/benchmark?slug=spade-zero-shot-raid-abstracts-tpr-at-5-percent-fpr · How It Works · Data refreshed daily, snapshot 2026-11-16.