HiEviDR-Bench - Arxiv (RAG): leaderboard
HiEviDR-Bench (UCAS, Tsinghua and others, 2026) tests multimodal deep-research reports on 1,000 arXiv paper questions under the one-pass retrieval-augmented pipeline. A Qwen3-VL-235B-A22B judge scores each report against a hierarchical evidence graph on five 0-20 dimensions (report quality, evidence traceability, and gated citation, claim and answer scores); the score is their sum from 0 to 100, higher is better.
Metric: Overall score (0-100): sum of five 0-20 dimension scores (multimodal report quality, evidence traceability, and progressively gated citation, claim and answer scores) judged by Qwen3-VL-235B-A22B-Instruct against the hierarchical evidence graph, on the 1,000-question arXiv subset; MLLM with RAG: one-pass report generation over the top-15 retrieved multimodal evidence items; higher is better. Source: arxiv.org. Saturation forecast: Around 2034. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol | 34.03 | #30 |
| 2 | Gemma 4 31B (IT) | 33.82 | #342 |
| 3 | GPT-5 | 33.34 | #167 |
| 4 | Qwen 3.5 27B | 32.83 | #359 |
| 5 | Grok 4.5 | 32.79 | #82 |
| 6 | gemma-4-E4B-it | 32.49 | #1469 |
| 7 | Qwen 3 VL 8B Instruct | 32.18 | #981 |
| 8 | Qwen 3.5 4B | 31.97 | #1175 |
| 9 | Qwen 3.5 35B A3B | 30.82 | #482 |
| 10 | Qwen 3.5 9B | 30.19 | #803 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=hievidr-bench-arxiv-rag · How It Works · Data refreshed daily, snapshot 2026-11-13.