SCOPED - CC-OCR V2 Recognition: leaderboard

SCOPED v1 Table1; final4B/8B independently distilled models from exactQwen3VLInstruct backbones, no skill text at student inference. Exact eval release xiongyq/SCOPED-Eval revision0b43c3d2b5cd3238b4c735976ebaefc28db6d6b9; counts491,527,1790,2500,1168,1740,2600,1000; PixMo540annotations minus13missingimages is published527cohort. VisualPuzzles source splittrain;WeMath testmini;CCOCR recognitiononly. Overall arithmetic mean of eight percentages. Primary code disables Qwen3 thinking on OCR recognition; micro-F1, not question accuracy. Metric: Micro-F1 (%). Higher is better. Source: https://arxiv.org/html/2610.22217v1

Metric: Micro-F1 (%). Source: arxiv.org. Saturation forecast: Not forecast. 13 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.286.31#109
2Qwen 3 VL 8B Instruct85.72#414
3Qwen 3 VL 4B Instruct82.86#510
4Claude Sonnet 4.682.37#89
5Claude Opus 4.680.74#60
6GPT-5.472.35#78

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.

Interactive version: theaggregate.ai/benchmark?slug=scoped-cc-ocr-v2-recognition · How It Works · Data refreshed daily, snapshot 2026-10-17.