LookZoom Component Ablation 98 - Five-Benchmark Average: leaderboard
LookZoom v1: Qwen3-VL-Instruct at 2B/4B/8B. Fixed 500-question subsets (seed 0) of DocVQA val (ANLS),InfographicVQA val (ANLS),ChartQA test (relaxed accuracy),TextVQA val (VQA accuracy), plus 300 held-out V-CoT-Doc (strict match). Per-view budget B means B * 32^2 pixels preserving aspect ratio, not total tokens. Single view/AttWarp/replace answer from 1 view; ViCrop/ground-then-crop/GapSight/LookZoom use 2. LookZoom reader uses GRPO LoRA; pointer trained from own correct answers; GapSight is authors reimplementation. Distinct trained systems remain separate. Table3: fixed 4B, exact view/pointer/reader arm retained. Exclude best-fixed-view-per-budget oracle selection from model roster. Five-Benchmark Average. Metric: Accuracy (%).
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | LookZoom Qwen3-VL-4B Per-sample action head ( ours ) | 63.6 | |
| 2 | LookZoom Qwen3-VL-4B Square .5 .5 , <look> token | 62.9 | |
| 3 | LookZoom Qwen3-VL-4B Action head without adaptive windows | 62.9 | |
| 4 | LookZoom Qwen3-VL-4B Adapt. window, <look> token | 62.5 | |
| 5 | LookZoom Qwen3-VL-4B Square .5 .5 , pre-answer, same layers | 62.4 | |
| 6 | LookZoom Qwen3-VL-4B Crop .7 .7 , pre-answer, same layers | 58.2 | |
| 7 | LookZoom Qwen3-VL-4B RL reader, crop .7 .7 (decision) | 58.2 | |
| 8 | LookZoom Qwen3-VL-4B Crop .7 .7 , <look> token | 57.8 | |
| 9 | LookZoom Qwen3-VL-4B Adapt. window, pre-answer, best layers † | 56.8 | |
| 10 | LookZoom Qwen3-VL-4B Base reader, crop .7 .7 (decision) | 56.7 |
Interactive version: theaggregate.ai/benchmark?slug=lookzoom-component-ablation-98-five-benchmark-average · How It Works · Data refreshed daily, snapshot 2026-10-27.