TRACK - Multi-Hop QA (MeLLo): leaderboard

Metric: Holistic pass (%; multi-hop questions over Wikidata fact chains, 500 items; the final answer is correct and the reasoning entails every required fact; answered through MeLLo, which keeps the facts in an external memory and retrieves them by question decomposition). Source: arxiv.org. Saturation forecast: Around November 2027. 6 models tracked.

Top models

#ModelScore
1Qwen 3 8B10.6
2Qwen 3 4B7.9
3Qwen 3 1.7B5.5

Interactive version: theaggregate.ai/benchmark?slug=track-multi-hop-qa-mello · How It Works · Data refreshed daily, snapshot 2026-09-26.