ReSUM - QMSum - R1: leaderboard
ReSUM v1 Table5: query-focused long-meeting summarization on QMSum and SQuALITY; source-native zero-shot, CoT, RAG, fine-tuned and multi-agent methods remain separate run identities. Short source model labels (including LLaMA3-3B and GPT-4-mini) are not bound to a guessed checkpoint. R1/R2/RL, BERTScore, Mover and COMET are native 0–1 values; chrF is native percent. No transformation, model alias, cross-method pooling or resource metric.
Metric: Native score (0–1). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Our Method (ReSUM Run: method=ReSUM Multi-Agent;checkpoint=source-native;effort=unreported) | 0.38 | |
| 2 | FT+Res Qwen (ReSUM Run: method=End-to-End Fine-tuned with Reasoning;checkpoint=source-native;effort=unreported) | 0.35 | |
| 3 | FT Qwen (ReSUM Run: method=Fine-tuned (FT);checkpoint=source-native;effort=unreported) | 0.33 | |
| 4 | GPT-4-mini (ReSUM Run: method=Zero-shot;checkpoint=source-native;effort=unreported) | 0.31 | |
| 5 | RAG-BM25 (ReSUM Run: method=Retrieval-Augmented Generation (RAG);checkpoint=source-native;effort=unreported) | 0.3 | |
| 6 | RAG-CONTRIEVER (ReSUM Run: method=Retrieval-Augmented Generation (RAG);checkpoint=source-native;effort=unreported) | 0.3 | |
| 7 | RAG-HYBRID (ReSUM Run: method=Retrieval-Augmented Generation (RAG);checkpoint=source-native;effort=unreported) | 0.29 | |
| 8 | FT LLaMA (ReSUM Run: method=Fine-tuned (FT);checkpoint=source-native;effort=unreported) | 0.29 | |
| 9 | COT LLaMA (ReSUM Run: method=Chain-of-Thought (CoT);checkpoint=source-native;effort=unreported) | 0.28 | |
| 10 | COT Qwen (ReSUM Run: method=Chain-of-Thought (CoT);checkpoint=source-native;effort=unreported) | 0.28 |
Interactive version: theaggregate.ai/benchmark?slug=resum-qmsum-r1 · How It Works · Data refreshed daily, snapshot 2026-11-12.