MosaicLeaks (Privacy-Aware Prompt): leaderboard

Metric: Strict chain success (%; share of 344 test multi-hop research tasks with every hop answered correctly, mean of three runs; with the privacy-aware planning prompt). Source: arxiv.org. Saturation forecast: Around December 2027. 6 models tracked.

Top models

#ModelScore
1Gemma 4 31B (IT)60.8
2GPT-OSS-20B58.3
3Step 3.5 Flash51.6
4Qwen 3 8B50.1
5Qwen 3 4B Instruct44.5

Interactive version: theaggregate.ai/benchmark?slug=mosaicleaks-privacy-aware-prompt · How It Works · Data refreshed daily, snapshot 2026-09-26.