SPY Release Evaluation - OCR - Released Checkpoints: leaderboard
SPY Release Evaluation - OCR - Released Checkpoints: Native benchmark score. SPY-Bench arXiv 2611.13997v1: personalized visual-privacy compliance, scores 0-100. Native distractor/scenario/conflict and ICS/RtA/AtA/HMS columns remain separate. Full official source model labels bind the evaluated checkpoints. Official repository release links bind four fine-tuned Qwen2-VL-7B-Instruct SFT/DPO/NCA/NCA-P checkpoints; they are distinct released models, not run wrappers around the original model. Self-moderation is an inference configuration of the original. Table 7 first row is an external official result and is not recounted. API effort is unreported. Native source condition: Released Checkpoints.
Metric: Native benchmark score. Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2 VL 7B Instruct | 862 | #2569 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=spy-release-evaluation-ocr-released-checkpoints · How It Works · Data refreshed daily, snapshot 2026-11-12.