HiEviDR-Bench - Arxiv (Deep Research): leaderboard
HiEviDR-Bench (UCAS, Tsinghua and others, 2026) tests multimodal deep-research reports on 1,000 arXiv paper questions under the iterative deep-research pipeline. A Qwen3-VL-235B-A22B judge scores each report against a hierarchical evidence graph on five 0-20 dimensions (report quality, evidence traceability, and gated citation, claim and answer scores); the score is their sum from 0 to 100, higher is better.
Metric: Overall score (0-100): sum of five 0-20 dimension scores (multimodal report quality, evidence traceability, and progressively gated citation, claim and answer scores) judged by Qwen3-VL-235B-A22B-Instruct against the hierarchical evidence graph, on the 1,000-question arXiv subset; MLLM with Deep Research: up to three rounds of question refinement with top-20 retrieval, re-ranked to 25 text chunks and 5 images; higher is better. Source: arxiv.org. Saturation forecast: Around 2033. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Grok 4.5 | 35.95 | #82 |
| 2 | GPT-5.6 Sol | 35.13 | #30 |
| 3 | Qwen 3.5 9B | 35.11 | #803 |
| 4 | Qwen 3 VL 8B Instruct | 35.1 | #981 |
| 5 | GPT-5 | 34.87 | #167 |
| 6 | Gemma 4 31B (IT) | 34.87 | #342 |
| 7 | Qwen 3.5 27B | 34.65 | #359 |
| 8 | Qwen 3.5 35B A3B | 34.61 | #482 |
| 9 | Qwen 3.5 4B | 34.26 | #1175 |
| 10 | GPT-5 Mini | 34 | #348 |
| 11 | gemma-4-E4B-it | 33.27 | #1469 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=hievidr-bench-arxiv-deep-research · How It Works · Data refreshed daily, snapshot 2026-11-13.